Jul 08 00:58:31 devstack cinder-volume[76001]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 00:58:31 devstack cinder-volume[76001]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 00:58:31 devstack cinder-volume[76001]: we strongly recommend against using it for new projects. Jul 08 00:58:31 devstack cinder-volume[76001]: If you are already using Eventlet, we recommend migrating to a different Jul 08 00:58:31 devstack cinder-volume[76001]: framework. For more detail see Jul 08 00:58:31 devstack cinder-volume[76001]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 00:58:31 devstack cinder-volume[76001]: import eventlet # noqa Jul 08 00:58:34 devstack cinder-volume[76001]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76001) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 00:58:34 devstack cinder-volume[76001]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76001) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 00:58:34 devstack cinder-volume[76001]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76001) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 00:58:35 devstack cinder-volume[76001]: INFO dbcounter [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Registered counter for database cinder Jul 08 00:58:35 devstack cinder-volume[76001]: DEBUG oslo_db.sqlalchemy.engines [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76001) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 00:58:35 devstack cinder-volume[76001]: DEBUG dbcounter [-] [76001] Writer thread running {{(pid=76001) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 00:58:35 devstack cinder-volume[76001]: INFO cinder.rpc [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 00:58:35 devstack cinder-volume[76001]: INFO cinder.rpc [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_db.sqlalchemy.engines [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76001) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 00:58:36 devstack cinder-volume[76001]: INFO cinder.volume.manager [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Determined volume DB was empty at startup. Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG cinder.volume.manager [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76001) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 00:58:36 devstack cinder-volume[76001]: INFO cinder.volume.manager [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 00:58:36 devstack cinder-volume[76001]: WARNING stevedore.named [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 00:58:36 devstack cinder-volume[76001]: WARNING castellan.key_manager [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 00:58:36 devstack cinder-volume[76001]: WARNING cinder.keymgr.conf_key_mgr [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG cinder.volume.drivers.lvm [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76001) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_concurrency.processutils [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76001) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_concurrency.processutils [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] CMD "cinder-rtstool verify" returned: 0 in 0.431s {{(pid=76001) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_db.sqlalchemy.engines [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76001) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 00:58:36 devstack cinder-volume[76001]: INFO cinder.rpc [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 08 00:58:36 devstack cinder-volume[76001]: INFO cinder.rpc [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 08 00:58:36 devstack cinder-volume[76001]: WARNING stevedore.named [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 00:58:36 devstack cinder-volume[76001]: WARNING castellan.key_manager [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 00:58:36 devstack cinder-volume[76001]: INFO cinder.volume.manager [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_db.sqlalchemy.engines [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76001) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 00:58:36 devstack cinder-volume[76001]: INFO oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Starting 1 workers Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Started child 76166 {{(pid=76001) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Full set of CONF: {{(pid=76001) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] ******************************************************************************** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Configuration options gathered from: {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] ================================================================================ {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] allow_availability_zone_fallback = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] allow_compression_on_image_upload = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] allowed_direct_url_schemes = [] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] api_rate_limit = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] auth_strategy = keystone {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] az_cache_duration = 3600 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_availability_zone = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_host = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_name = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76166]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_stats_polling_interval = 60 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backup_api_class = cinder.backup.api.API {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backup_name_template = backup-%s {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backup_use_same_host = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backup_use_temp_snapshot = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] chap_password = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] chap_username = {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cinder_internal_tenant_project_id = 8252f93eae2d42db9079609249c2a9e9 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cinder_internal_tenant_user_id = bd5d3620af36410aaba8231eb8116640 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cloned_volume_same_az = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cluster = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] compression_format = gzip {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] compute_api_class = cinder.compute.nova.API {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] config_dir = [] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] config_source = [] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] control_exchange = openstack {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] debug = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] default_availability_zone = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] default_group_type = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] default_volume_type = lvmdriver-1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] disk_geometry = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] driver_client_cert = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] driver_client_cert_key = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] driver_data_namespace = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] driver_ssl_cert_path = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] driver_ssl_cert_verify = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] driver_use_ssl = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] enable_force_upload = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] enable_new_services = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] enable_unsupported_driver = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] enforce_multipath_for_image_xfer = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] filter_function = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] glance_api_insecure = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] glance_api_servers = ['http://192.168.122.248/image'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] glance_api_ssl_compression = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] glance_ca_certificates_file = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] glance_catalog_info = image:glance:publicURL {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] glance_certfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] glance_keyfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] glance_num_retries = 3 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] glance_request_timeout = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] goodness_function = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] graceful_shutdown_timeout = 5 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] group_api_class = cinder.group.api.API {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] host = devstack {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] image_compress_on_upload = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] image_conversion_address_space_limit = 1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] image_conversion_cpu_limit = 60 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] image_conversion_disable = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] image_upload_use_cinder_backend = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] image_upload_use_internal_tenant = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] image_volume_cache_enabled = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] image_volume_cache_max_count = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] image_volume_cache_max_size_gb = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] init_host_max_objects_retrieval = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] instance_format = [instance: %(uuid)s] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] iscsi_target_flags = {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] iscsi_write_cache = on {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] iser_helper = tgtadm {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] iser_ip_address = 192.168.122.248 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] iser_port = 3260 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] log_color = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] log_config_append = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] log_dir = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] log_file = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] log_options = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] log_rotate_interval = 1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] log_rotate_interval_type = days {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] log_rotation_type = none {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] max_age = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] max_logfile_count = 30 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] max_logfile_size_mb = 200 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] max_over_subscription_ratio = 20.0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] message_reap_interval = 86400 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] message_ttl = 2592000 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] migration_create_volume_timeout_secs = 300 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] monkey_patch = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] monkey_patch_modules = [] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] my_ip = 192.168.122.248 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] no_snapshot_gb_quota = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] num_iser_scan_tries = 3 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] num_shell_tries = 3 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] num_volume_device_scan_tries = 3 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] nvmeof_conn_info_version = 1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] nvmet_ns_id = 10 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] nvmet_port_id = 1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] osapi_max_limit = 1000 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] osapi_volume_ext_list = [] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] osapi_volume_listen_port = 8776 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] osapi_volume_use_ssl = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] osapi_volume_workers = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] per_volume_size_limit = -1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] periodic_fuzzy_delay = 60 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] periodic_interval = 60 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] public_endpoint = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] publish_errors = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] quota_backup_gigabytes = 1000 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] quota_backups = 10 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] quota_gigabytes = 1000 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] quota_groups = 10 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] quota_snapshots = 10 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] quota_volumes = 10 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] rate_limit_burst = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] rate_limit_except_level = CRITICAL {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] rate_limit_interval = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] reinit_driver_count = 3 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] replication_device = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] report_discard_supported = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] report_interval = 120 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] reservation_clean_interval = 86400 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] reservation_expire = 86400 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] reserved_image_namespaces = [] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] reserved_percentage = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] rpc_response_timeout = 120 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] run_external_periodic_tasks = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] scst_target_driver = iscsi {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] scst_target_iqn_name = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] service_down_time = 720 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] shell_completion = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] snapshot_name_template = snapshot-%s {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] snapshot_same_host = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] split_loggers = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] state_path = /opt/stack/data/cinder {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] storage_availability_zone = nova {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] storage_protocol = iSCSI {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] syslog_log_facility = LOG_USER {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] target_helper = lioadm {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] target_ip_address = 192.168.122.248 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] target_port = 3260 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] target_protocol = iscsi {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] target_secondary_ip_addresses = [] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] trace_flags = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] transport_url = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] until_refresh = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] use_chap_auth = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] use_default_quota_class = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] use_journal = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] use_json = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] use_multipath_for_image_xfer = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] use_stderr = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] use_syslog = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] verify_glance_signatures = enabled {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] volume_api_class = cinder.volume.api.API {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] volume_backend_name = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] volume_clear = zero {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] volume_clear_ionice = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76166]: INFO cinder.volume.manager [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] volume_clear_size = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] volume_copy_bps_limit = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] volume_dd_blocksize = 1M {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] volume_name_template = volume-%s {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] volume_service_inithost_offload = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] volume_usage_audit_period = month {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] zoning_mode = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_concurrency.disable_process_locking = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.auth_section = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.auth_type = password {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.auth_version = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.cache = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.certfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.include_service_catalog = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.insecure = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.interface = public {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.keyfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.memcache_password = {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:36 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.memcache_username = {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.region_name = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.service_type = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.248/identity {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.backend = dogpile.cache.null {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.backend_argument = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.backend_expiration_time = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.config_prefix = cache.oslo {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.debug_cache_backend = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.enable_retry_client = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.enable_socket_keepalive = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.enabled = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.expiration_time = 600 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.hashclient_retry_attempts = 2 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.memcache_dead_retry = 300 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.memcache_pool_maxsize = 10 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.memcache_sasl_enabled = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.password = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.proxies = [] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.redis_db = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.redis_server = localhost:6379 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.retry_attempts = 2 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.retry_delay = 0.0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.socket_keepalive_count = 1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.socket_keepalive_idle = 1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.socket_keepalive_interval = 1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.socket_timeout = 1.0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.tls_allowed_ciphers = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.tls_cafile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.tls_certfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.tls_enabled = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.tls_keyfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cache.username = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] coordination.backend_url = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] database.asyncio_connection = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] database.asyncio_slave_connection = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] database.backend = sqlalchemy {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] database.connection = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] database.connection_debug = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] database.connection_parameters = {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] database.connection_recycle_time = 3600 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] database.connection_trace = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] database.db_inc_retry_interval = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] database.db_max_retries = 20 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] database.db_max_retry_interval = 10 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] database.db_retry_interval = 1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] database.max_overflow = 50 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] database.max_pool_size = 5 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] database.max_retries = 10 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] database.mysql_wsrep_sync_wait = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] database.pool_timeout = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] database.retry_interval = 10 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.056s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] database.slave_connection = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] database.sqlite_synchronous = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] database.synchronous_reader = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] database.use_db_reconnect = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] profiler.connection_string = messaging:// {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] profiler.enabled = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] profiler.es_doc_type = notification {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] profiler.es_scroll_size = 10000 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] profiler.es_scroll_time = 2m {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] profiler.filter_error_trace = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] profiler.hmac_keys = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] profiler.sentinel_service_name = mymaster {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] profiler.socket_timeout = 0.1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] profiler.trace_requests = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] profiler.trace_sqlalchemy = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] profiler_jaeger.process_tags = {} {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] profiler_jaeger.service_name_prefix = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] profiler_otlp.service_name_prefix = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_policy.enforce_new_defaults = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_policy.enforce_scope = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_policy.policy_default_rule = default {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_policy.policy_file = policy.yaml {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] privsep_osbrick.group = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] privsep_osbrick.helper_command = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] privsep_osbrick.user = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cinder_sys_admin.group = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cinder_sys_admin.helper_command = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] cinder_sys_admin.user = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] service_user.auth_section = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] service_user.auth_type = password {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] service_user.cafile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] service_user.certfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] service_user.collect_timing = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] service_user.insecure = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] service_user.keyfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] service_user.send_service_user_token = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] service_user.split_loggers = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] service_user.timeout = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] glance.auth_section = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] glance.auth_type = password {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] glance.certfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] glance.collect_timing = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] glance.insecure = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] glance.keyfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] glance.region_name = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] glance.split_loggers = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] glance.timeout = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.backend_availability_zone = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.chap_password = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.chap_username = {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.disk_geometry = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.driver_client_cert = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.driver_client_cert_key = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.driver_data_namespace = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.driver_use_ssl = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.extra_capabilities = {} {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.filter_function = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.goodness_function = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.iscsi_target_flags = {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.iscsi_write_cache = on {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.iser_helper = tgtadm {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.iser_ip_address = 192.168.122.248 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.iser_port = 3260 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.lvm_share_target = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.lvm_type = auto {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.num_shell_tries = 3 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.replication_device = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.report_discard_supported = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.reserved_percentage = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.target_helper = tgtadm {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.target_ip_address = 192.168.122.248 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.target_port = 3260 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.target_protocol = iscsi {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.trace_flags = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.unique_fqdn_network = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.use_chap_auth = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.volume_backend_name = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.volume_clear = zero {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.volume_clear_ionice = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.volume_clear_size = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_reports.file_event_handler = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_reports.log_dir = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.backend_host = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.chap_password = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.chap_username = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.disk_geometry = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.driver_client_cert = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.extra_capabilities = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.filter_function = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.goodness_function = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.iser_helper = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.iser_ip_address = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.iser_port = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.lvm_share_target = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.lvm_type = auto {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.num_shell_tries = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.replication_device = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.report_discard_supported = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.reserved_percentage = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.scst_target_driver = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.storage_protocol = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.target_helper = lioadm {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.target_ip_address = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.target_port = 3260 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.trace_flags = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.use_chap_auth = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.volume_clear = zero {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack sudo[76170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.volume_clear_size = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack sudo[76170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] lvmdriver-1.volumes_dir = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.ssl = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_notifications.driver = [] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_notifications.retry = -1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] key_manager.fixed_key = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] barbican.barbican_api_version = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] barbican.barbican_endpoint = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] barbican.barbican_endpoint_type = public {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] barbican.barbican_region_name = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] barbican.cafile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] barbican.certfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] barbican.collect_timing = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] barbican.insecure = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] barbican.keyfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] barbican.number_of_retries = 60 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] barbican.retry_delay = 1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] barbican.send_service_user_token = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] barbican.split_loggers = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] barbican.timeout = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] barbican.verify_ssl = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] barbican.verify_ssl_path = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] barbican_service_user.auth_section = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] barbican_service_user.auth_type = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] barbican_service_user.cafile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] barbican_service_user.certfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] barbican_service_user.collect_timing = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] barbican_service_user.insecure = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] barbican_service_user.keyfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] barbican_service_user.split_loggers = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] barbican_service_user.timeout = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] vault.approle_role_id = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] vault.approle_secret_id = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] vault.kv_mountpoint = secret {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] vault.kv_path = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] vault.kv_version = 2 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] vault.namespace = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] vault.root_token_id = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] vault.ssl_ca_crt_file = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] vault.timeout = 60.0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] vault.use_ssl = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:58:37 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] ******************************************************************************** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 00:58:38 devstack sudo[76170]: pam_unix(sudo:session): session closed for user root Jul 08 00:58:38 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.919s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:38 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:38 devstack sudo[76379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 00:58:38 devstack sudo[76379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:58:38 devstack sudo[76379]: pam_unix(sudo:session): session closed for user root Jul 08 00:58:38 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.863s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:38 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 00:58:38 devstack cinder-volume[76166]: INFO cinder.brick.local_dev.lvm [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 08 00:58:38 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:38 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:38 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:38 devstack sudo[76585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 00:58:38 devstack sudo[76585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:58:39 devstack sudo[76585]: pam_unix(sudo:session): session closed for user root Jul 08 00:58:39 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.853s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:39 devstack cinder-volume[76166]: DEBUG cinder.brick.local_dev.lvm [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76166) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 08 00:58:39 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:39 devstack sudo[76737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 00:58:39 devstack sudo[76737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:58:41 devstack sudo[76737]: pam_unix(sudo:session): session closed for user root Jul 08 00:58:41 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.266s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:41 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:41 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:41 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:41 devstack sudo[76944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 00:58:41 devstack sudo[76944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:58:41 devstack sudo[76944]: pam_unix(sudo:session): session closed for user root Jul 08 00:58:41 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.881s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:41 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:41 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:41 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:42 devstack sudo[76948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 08 00:58:42 devstack sudo[76948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:58:42 devstack sudo[76948]: pam_unix(sudo:session): session closed for user root Jul 08 00:58:42 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.777s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:42 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:42 devstack sudo[76952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 00:58:42 devstack sudo[76952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:58:43 devstack sudo[76952]: pam_unix(sudo:session): session closed for user root Jul 08 00:58:43 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.842s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:43 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:43 devstack sudo[76963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 00:58:43 devstack sudo[76963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:58:44 devstack sudo[76963]: pam_unix(sudo:session): session closed for user root Jul 08 00:58:44 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.811s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:44 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:44 devstack sudo[76972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 00:58:44 devstack sudo[76972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:58:45 devstack sudo[76972]: pam_unix(sudo:session): session closed for user root Jul 08 00:58:45 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.727s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:45 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:45 devstack sudo[76977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 00:58:45 devstack sudo[76977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:58:45 devstack sudo[76977]: pam_unix(sudo:session): session closed for user root Jul 08 00:58:45 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.722s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:45 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:45 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:45 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:45 devstack sudo[76981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 00:58:45 devstack sudo[76981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:58:46 devstack sudo[76981]: pam_unix(sudo:session): session closed for user root Jul 08 00:58:46 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.746s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:46 devstack cinder-volume[76166]: INFO cinder.volume.drivers.lvm [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 08 00:58:46 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:46 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:46 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:46 devstack sudo[76992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 00:58:46 devstack sudo[76992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:58:46 devstack cinder-volume[76001]: DEBUG dbcounter [-] [76001] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76001) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 00:58:47 devstack sudo[76992]: pam_unix(sudo:session): session closed for user root Jul 08 00:58:47 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.766s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:47 devstack cinder-volume[76166]: DEBUG cinder.volume.drivers.lvm [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Updating volume stats {{(pid=76166) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 00:58:47 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:47 devstack sudo[77108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 00:58:47 devstack sudo[77108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:58:48 devstack sudo[77108]: pam_unix(sudo:session): session closed for user root Jul 08 00:58:48 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.793s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:48 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:48 devstack sudo[77248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 00:58:48 devstack sudo[77248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:58:48 devstack sudo[77248]: pam_unix(sudo:session): session closed for user root Jul 08 00:58:48 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.714s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:48 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:48 devstack sudo[77251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 00:58:48 devstack sudo[77251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:58:49 devstack sudo[77251]: pam_unix(sudo:session): session closed for user root Jul 08 00:58:49 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.703s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:49 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:49 devstack sudo[77255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 00:58:49 devstack sudo[77255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:58:50 devstack sudo[77255]: pam_unix(sudo:session): session closed for user root Jul 08 00:58:50 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.694s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:50 devstack cinder-volume[76166]: INFO cinder.volume.driver [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Driver hasn't implemented _init_vendor_properties() Jul 08 00:58:50 devstack cinder-volume[76166]: DEBUG cinder.volume.driver [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76166) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 00:58:50 devstack cinder-volume[76166]: DEBUG oslo_db.sqlalchemy.engines [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76166) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 00:58:50 devstack cinder-volume[76166]: DEBUG dbcounter [-] [76166] Writer thread running {{(pid=76166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 00:58:50 devstack cinder-volume[76166]: DEBUG cinder.db.api [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Building query based on filter {{(pid=76166) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 00:58:50 devstack cinder-volume[76166]: DEBUG cinder.image.image_utils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76166) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 00:58:50 devstack cinder-volume[76166]: INFO cinder.keymgr.migration [None req-a292864d-cb6f-4903-931c-500f9943326a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 00:58:50 devstack cinder-volume[76166]: DEBUG cinder.volume.drivers.lvm [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Updating volume stats {{(pid=76166) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 00:58:50 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:50 devstack sudo[77259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 00:58:50 devstack sudo[77259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:58:51 devstack sudo[77259]: pam_unix(sudo:session): session closed for user root Jul 08 00:58:51 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:51 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:51 devstack sudo[77265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 00:58:51 devstack sudo[77265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:58:51 devstack sudo[77265]: pam_unix(sudo:session): session closed for user root Jul 08 00:58:51 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.708s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:51 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:51 devstack sudo[77268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 00:58:51 devstack sudo[77268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:58:52 devstack sudo[77268]: pam_unix(sudo:session): session closed for user root Jul 08 00:58:52 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.712s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:52 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:52 devstack sudo[77271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 00:58:52 devstack sudo[77271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:58:53 devstack sudo[77271]: pam_unix(sudo:session): session closed for user root Jul 08 00:58:53 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.710s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:53 devstack cinder-volume[76166]: DEBUG cinder.manager [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Notifying Schedulers of capabilities ... {{(pid=76166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 00:58:53 devstack cinder-volume[76166]: INFO cinder.volume.manager [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Driver initialization completed successfully. Jul 08 00:58:53 devstack cinder-volume[76166]: INFO cinder.manager [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Initiating service 2 cleanup Jul 08 00:58:53 devstack cinder-volume[76166]: INFO cinder.manager [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Service 2 cleanup completed. Jul 08 00:58:53 devstack cinder-volume[76166]: DEBUG cinder.service [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Creating RPC server for service cinder-volume {{(pid=76166) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 00:58:53 devstack cinder-volume[76166]: DEBUG cinder.service [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76166) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 00:58:53 devstack cinder-volume[76166]: INFO cinder.volume.manager [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 08 00:58:53 devstack cinder-volume[76166]: DEBUG cinder.volume.drivers.lvm [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Updating volume stats {{(pid=76166) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 00:58:53 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:53 devstack sudo[77275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 00:58:53 devstack sudo[77275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:58:54 devstack sudo[77275]: pam_unix(sudo:session): session closed for user root Jul 08 00:58:54 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.777s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:54 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:54 devstack sudo[77279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 00:58:54 devstack sudo[77279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:58:54 devstack sudo[77279]: pam_unix(sudo:session): session closed for user root Jul 08 00:58:54 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.700s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:54 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:54 devstack sudo[77321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 00:58:54 devstack sudo[77321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:58:55 devstack sudo[77321]: pam_unix(sudo:session): session closed for user root Jul 08 00:58:55 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.697s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:55 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:55 devstack sudo[77378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 00:58:55 devstack sudo[77378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:58:56 devstack sudo[77378]: pam_unix(sudo:session): session closed for user root Jul 08 00:58:56 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:56 devstack cinder-volume[76166]: INFO cinder.volume.manager [None req-18e63878-8ef2-40b8-83f7-c5f480977ccd None None] Driver post RPC initialization completed successfully. Jul 08 00:59:06 devstack cinder-volume[76166]: DEBUG dbcounter [-] [76166] Writing DB stats cinder:SELECT=4 {{(pid=76166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 00:59:06 devstack cinder-volume[76166]: DEBUG dbcounter [-] [76166] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 00:59:35 devstack cinder-volume[76166]: DEBUG oslo_service.periodic_task [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 00:59:35 devstack cinder-volume[76166]: DEBUG cinder.volume.drivers.lvm [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] Updating volume stats {{(pid=76166) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 00:59:35 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:59:35 devstack sudo[78717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 00:59:35 devstack sudo[78717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:59:36 devstack sudo[78717]: pam_unix(sudo:session): session closed for user root Jul 08 00:59:36 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.703s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:59:36 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:59:36 devstack sudo[78727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 00:59:36 devstack sudo[78727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:59:36 devstack sudo[78727]: pam_unix(sudo:session): session closed for user root Jul 08 00:59:36 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.673s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:59:36 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:59:36 devstack sudo[78734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 00:59:36 devstack sudo[78734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:59:37 devstack sudo[78734]: pam_unix(sudo:session): session closed for user root Jul 08 00:59:37 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.688s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:59:37 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:59:37 devstack sudo[78748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 00:59:37 devstack sudo[78748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:59:38 devstack sudo[78748]: pam_unix(sudo:session): session closed for user root Jul 08 00:59:38 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:59:38 devstack cinder-volume[76166]: DEBUG cinder.manager [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] Notifying Schedulers of capabilities ... {{(pid=76166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 00:59:38 devstack cinder-volume[76166]: DEBUG oslo_service.periodic_task [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] Running periodic task VolumeManager._thread_info {{(pid=76166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 00:59:38 devstack cinder-volume[76166]: DEBUG cinder.volume.manager [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] thread count: 6 {{(pid=76166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 00:59:38 devstack cinder-volume[76166]: DEBUG cinder.volume.manager [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] thread info: [<_MainThread(MainThread, started 133957366878336)>, , , , , ] {{(pid=76166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:01:06 devstack cinder-volume[76166]: DEBUG dbcounter [-] [76166] Writing DB stats cinder:SELECT=1 {{(pid=76166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:01:06 devstack cinder-volume[76166]: DEBUG dbcounter [-] [76166] Writing DB stats cinder:UPDATE=1 {{(pid=76166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:01:35 devstack cinder-volume[76166]: DEBUG oslo_service.periodic_task [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:01:35 devstack cinder-volume[76166]: DEBUG cinder.volume.drivers.lvm [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] Updating volume stats {{(pid=76166) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 01:01:35 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:01:35 devstack sudo[83700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:01:35 devstack sudo[83700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:01:36 devstack sudo[83700]: pam_unix(sudo:session): session closed for user root Jul 08 01:01:36 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.694s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:01:36 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:01:36 devstack sudo[83730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:01:36 devstack sudo[83730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:01:36 devstack sudo[83730]: pam_unix(sudo:session): session closed for user root Jul 08 01:01:36 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.727s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:01:36 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:01:36 devstack sudo[83756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:01:36 devstack sudo[83756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:01:37 devstack sudo[83756]: pam_unix(sudo:session): session closed for user root Jul 08 01:01:37 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.762s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:01:37 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:01:37 devstack sudo[83768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:01:37 devstack sudo[83768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:01:38 devstack sudo[83768]: pam_unix(sudo:session): session closed for user root Jul 08 01:01:38 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.674s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:01:38 devstack cinder-volume[76166]: DEBUG cinder.manager [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] Notifying Schedulers of capabilities ... {{(pid=76166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:01:38 devstack cinder-volume[76166]: DEBUG oslo_service.periodic_task [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] Running periodic task VolumeManager._thread_info {{(pid=76166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:01:38 devstack cinder-volume[76166]: DEBUG cinder.volume.manager [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] thread count: 6 {{(pid=76166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:01:38 devstack cinder-volume[76166]: DEBUG cinder.volume.manager [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] thread info: [<_MainThread(MainThread, started 133957366878336)>, , , , , ] {{(pid=76166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:02:35 devstack cinder-volume[76166]: DEBUG oslo_service.periodic_task [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:02:35 devstack cinder-volume[76166]: DEBUG cinder.volume.drivers.lvm [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] Updating volume stats {{(pid=76166) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 01:02:35 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:02:35 devstack sudo[85154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:02:35 devstack sudo[85154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:02:35 devstack sudo[85154]: pam_unix(sudo:session): session closed for user root Jul 08 01:02:36 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:02:36 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:02:36 devstack sudo[85180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:02:36 devstack sudo[85180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:02:36 devstack sudo[85180]: pam_unix(sudo:session): session closed for user root Jul 08 01:02:36 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.834s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:02:36 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:02:36 devstack sudo[85187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:02:36 devstack sudo[85187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:02:37 devstack sudo[85187]: pam_unix(sudo:session): session closed for user root Jul 08 01:02:37 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.741s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:02:37 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:02:37 devstack sudo[85202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:02:37 devstack sudo[85202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:02:38 devstack sudo[85202]: pam_unix(sudo:session): session closed for user root Jul 08 01:02:38 devstack cinder-volume[76166]: DEBUG oslo_concurrency.processutils [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.699s {{(pid=76166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:02:38 devstack cinder-volume[76166]: DEBUG cinder.manager [None req-cf0bc00f-4741-4a9d-8902-404256fc2764 None None] Notifying Schedulers of capabilities ... {{(pid=76166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:03:06 devstack cinder-volume[76166]: DEBUG dbcounter [-] [76166] Writing DB stats cinder:SELECT=1 {{(pid=76166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:03:06 devstack cinder-volume[76166]: DEBUG dbcounter [-] [76166] Writing DB stats cinder:UPDATE=1 {{(pid=76166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:03:28 devstack cinder-volume[76001]: INFO oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Caught SIGTERM, stopping children Jul 08 01:03:28 devstack cinder-volume[76001]: DEBUG oslo_concurrency.lockutils [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Acquiring lock "singleton_lock" {{(pid=76001) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 01:03:28 devstack cinder-volume[76001]: DEBUG oslo_concurrency.lockutils [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Acquired lock "singleton_lock" {{(pid=76001) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 01:03:28 devstack cinder-volume[76001]: DEBUG oslo_concurrency.lockutils [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Releasing lock "singleton_lock" {{(pid=76001) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 01:03:28 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Stop services. {{(pid=76001) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 01:03:28 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Killing children. {{(pid=76001) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 01:03:28 devstack cinder-volume[76001]: INFO oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Waiting on 1 children to exit Jul 08 01:03:33 devstack cinder-volume[76166]: DEBUG oslo_concurrency.lockutils [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Acquiring lock "singleton_lock" {{(pid=76166) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 01:03:33 devstack cinder-volume[76166]: DEBUG oslo_concurrency.lockutils [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Acquired lock "singleton_lock" {{(pid=76166) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 01:03:33 devstack cinder-volume[76166]: DEBUG oslo_concurrency.lockutils [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Releasing lock "singleton_lock" {{(pid=76166) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 01:03:33 devstack cinder-volume[76166]: WARNING amqp [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 01:03:33 devstack cinder-volume[76166]: WARNING amqp [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 01:03:33 devstack cinder-volume[76001]: INFO oslo_service.backend._eventlet.service [None req-2d8510b4-c797-4d00-825c-e793d83ccbc6 None None] Child 76166 exited with status 0 Jul 08 01:03:33 devstack cinder-volume[86304]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 01:03:33 devstack cinder-volume[86304]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 01:03:33 devstack cinder-volume[86304]: we strongly recommend against using it for new projects. Jul 08 01:03:33 devstack cinder-volume[86304]: If you are already using Eventlet, we recommend migrating to a different Jul 08 01:03:33 devstack cinder-volume[86304]: framework. For more detail see Jul 08 01:03:33 devstack cinder-volume[86304]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 01:03:33 devstack cinder-volume[86304]: import eventlet # noqa Jul 08 01:03:35 devstack cinder-volume[86304]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86304) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 01:03:35 devstack cinder-volume[86304]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86304) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 01:03:35 devstack cinder-volume[86304]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86304) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 01:03:36 devstack cinder-volume[86304]: INFO dbcounter [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] Registered counter for database cinder Jul 08 01:03:36 devstack cinder-volume[86304]: DEBUG oslo_db.sqlalchemy.engines [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86304) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG dbcounter [-] [86304] Writer thread running {{(pid=86304) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 01:03:37 devstack cinder-volume[86304]: INFO cinder.rpc [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 01:03:37 devstack cinder-volume[86304]: INFO cinder.rpc [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_db.sqlalchemy.engines [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86304) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:03:37 devstack cinder-volume[86304]: INFO cinder.volume.manager [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] Determined volume DB was empty at startup. Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG cinder.volume.manager [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86304) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 01:03:37 devstack cinder-volume[86304]: INFO cinder.volume.manager [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 01:03:37 devstack cinder-volume[86304]: WARNING stevedore.named [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 01:03:37 devstack cinder-volume[86304]: WARNING castellan.key_manager [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 01:03:37 devstack cinder-volume[86304]: WARNING cinder.keymgr.conf_key_mgr [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 01:03:37 devstack cinder-volume[86304]: INFO cinder.volume.manager [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_db.sqlalchemy.engines [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86304) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:03:37 devstack cinder-volume[86304]: INFO oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] Starting 1 workers Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] Started child 86518 {{(pid=86304) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] Full set of CONF: {{(pid=86304) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] ******************************************************************************** {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] Configuration options gathered from: {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] ================================================================================ {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] allow_availability_zone_fallback = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] allow_compression_on_image_upload = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] allowed_direct_url_schemes = [] {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] api_rate_limit = True {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] auth_strategy = keystone {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_availability_zone = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_host = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_name = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_stats_polling_interval = 60 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backup_api_class = cinder.backup.api.API {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backup_name_template = backup-%s {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backup_use_same_host = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backup_use_temp_snapshot = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] chap_password = **** {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] chap_username = {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cinder_internal_tenant_project_id = 8252f93eae2d42db9079609249c2a9e9 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cinder_internal_tenant_user_id = bd5d3620af36410aaba8231eb8116640 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cluster = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86518]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] compression_format = gzip {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] compute_api_class = cinder.compute.nova.API {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] config_dir = [] {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] config_source = [] {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] control_exchange = openstack {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] debug = True {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] default_availability_zone = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] default_group_type = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] default_volume_type = QuobyteHD {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] disk_geometry = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] driver_client_cert = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] driver_client_cert_key = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] driver_data_namespace = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] driver_ssl_cert_path = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] driver_ssl_cert_verify = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] driver_use_ssl = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] enable_new_services = True {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] enable_unsupported_driver = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] enabled_backends = ['QuobyteHD'] {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] enforce_multipath_for_image_xfer = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] filter_function = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] glance_api_insecure = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] glance_api_servers = ['http://192.168.122.248/image'] {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] glance_api_ssl_compression = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] glance_ca_certificates_file = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] glance_catalog_info = image:glance:publicURL {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] glance_certfile = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] glance_keyfile = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] glance_num_retries = 3 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] glance_request_timeout = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] goodness_function = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] graceful_shutdown_timeout = 5 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] group_api_class = cinder.group.api.API {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] host = devstack {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] image_compress_on_upload = True {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] image_conversion_address_space_limit = 1 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] image_conversion_cpu_limit = 60 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] image_conversion_disable = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] image_upload_use_cinder_backend = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] image_upload_use_internal_tenant = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] image_volume_cache_enabled = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] image_volume_cache_max_count = 0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] image_volume_cache_max_size_gb = 0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] init_host_max_objects_retrieval = 0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] instance_format = [instance: %(uuid)s] {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] iscsi_target_flags = {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] iscsi_write_cache = on {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] iser_helper = tgtadm {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] iser_ip_address = 192.168.122.248 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] iser_port = 3260 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] log_color = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] log_config_append = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] log_dir = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] log_file = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] log_options = True {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] log_rotate_interval = 1 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] log_rotate_interval_type = days {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] log_rotation_type = none {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] max_age = 0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] max_logfile_count = 30 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] max_logfile_size_mb = 200 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] max_over_subscription_ratio = 20.0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] message_reap_interval = 86400 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] message_ttl = 2592000 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] migration_create_volume_timeout_secs = 300 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] monkey_patch = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] monkey_patch_modules = [] {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] my_ip = 192.168.122.248 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] no_snapshot_gb_quota = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] num_iser_scan_tries = 3 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] num_shell_tries = 3 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] num_volume_device_scan_tries = 3 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] nvmeof_conn_info_version = 1 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] nvmet_ns_id = 10 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] nvmet_port_id = 1 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] osapi_max_limit = 1000 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] osapi_volume_ext_list = [] {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] osapi_volume_listen = 0.0.0.0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] osapi_volume_listen_port = 8776 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] osapi_volume_use_ssl = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] osapi_volume_workers = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] per_volume_size_limit = -1 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] periodic_fuzzy_delay = 60 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] periodic_interval = 60 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] project_id_regex = [0-9a-f\-]+ {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] public_endpoint = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] publish_errors = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] quota_backup_gigabytes = 1000 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] quota_backups = 10 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] quota_gigabytes = 1000 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] quota_groups = 10 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] quota_snapshots = 10 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] quota_volumes = 10 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] rate_limit_burst = 0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] rate_limit_except_level = CRITICAL {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] rate_limit_interval = 0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] reinit_driver_count = 3 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] replication_device = **** {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] report_discard_supported = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] report_interval = 120 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] reservation_clean_interval = 86400 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] reservation_expire = 86400 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] reserved_image_namespaces = [] {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] reserved_percentage = 0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] rpc_response_timeout = 120 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] run_external_periodic_tasks = True {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] scst_target_driver = iscsi {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] scst_target_iqn_name = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] service_down_time = 720 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] shell_completion = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] snapshot_name_template = snapshot-%s {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] split_loggers = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] state_path = /opt/stack/data/cinder {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] storage_availability_zone = nova {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] storage_protocol = iSCSI {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] syslog_log_facility = LOG_USER {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] target_helper = lioadm {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] target_ip_address = 192.168.122.248 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] target_port = 3260 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] target_protocol = iscsi {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] target_secondary_ip_addresses = [] {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] trace_flags = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] transfer_api_class = cinder.transfer.api.API {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] transport_url = **** {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] until_refresh = 0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] use_chap_auth = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] use_default_quota_class = True {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] use_journal = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] use_json = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] use_multipath_for_image_xfer = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] use_stderr = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] use_syslog = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] verify_glance_signatures = enabled {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] volume_api_class = cinder.volume.api.API {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] volume_backend_name = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] volume_clear = zero {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] volume_clear_ionice = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] volume_clear_size = 0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] volume_copy_bps_limit = 0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] volume_dd_blocksize = 1M {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] volume_name_template = volume-%s {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] volume_service_inithost_offload = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] volume_usage_audit_period = month {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] zoning_mode = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_concurrency.disable_process_locking = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.auth_section = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.auth_type = password {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.auth_version = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.cache = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.certfile = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.delay_auth_decision = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.http_connect_timeout = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.include_service_catalog = True {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.insecure = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.interface = public {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.keyfile = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.memcache_password = {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.memcache_username = {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.region_name = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.service_token_roles_required = True {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.service_type = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.token_cache_time = 300 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.248/identity {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.backend = dogpile.cache.null {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.backend_argument = **** {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.backend_expiration_time = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.config_prefix = cache.oslo {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.debug_cache_backend = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.enable_retry_client = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.enable_socket_keepalive = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.enabled = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.expiration_time = 600 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.hashclient_retry_attempts = 2 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.memcache_dead_retry = 300 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.memcache_pool_maxsize = 10 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.memcache_sasl_enabled = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.password = **** {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.proxies = [] {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.redis_db = 0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.redis_sentinel_service_name = mymaster {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.redis_server = localhost:6379 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.retry_attempts = 2 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.retry_delay = 0.0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.socket_keepalive_count = 1 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.socket_keepalive_idle = 1 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.socket_keepalive_interval = 1 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.socket_timeout = 1.0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.tls_allowed_ciphers = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.tls_cafile = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.tls_certfile = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.tls_enabled = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.tls_keyfile = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cache.username = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] coordination.backend_url = **** {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] database.asyncio_connection = **** {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] database.asyncio_slave_connection = **** {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] database.backend = sqlalchemy {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] database.connection = **** {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] database.connection_debug = 0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] database.connection_parameters = {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] database.connection_recycle_time = 3600 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] database.connection_trace = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] database.db_inc_retry_interval = True {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] database.db_max_retries = 20 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] database.db_max_retry_interval = 10 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] database.db_retry_interval = 1 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86518]: INFO cinder.volume.manager [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] database.max_overflow = 50 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] database.max_pool_size = 5 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] database.max_retries = 10 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] database.mysql_wsrep_sync_wait = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] database.pool_timeout = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] database.retry_interval = 10 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] database.slave_connection = **** {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] database.sqlite_synchronous = True {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] database.synchronous_reader = True {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] database.use_db_reconnect = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] profiler.connection_string = messaging:// {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] profiler.enabled = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] profiler.es_doc_type = notification {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] profiler.es_scroll_size = 10000 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] profiler.es_scroll_time = 2m {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86518]: DEBUG cinder.volume.drivers.remotefs [None req-6604197c-f028-4f14-8468-35c926343d15 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86518) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] profiler.filter_error_trace = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] profiler.hmac_keys = **** {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] profiler.sentinel_service_name = mymaster {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] profiler.socket_timeout = 0.1 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] profiler.trace_requests = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] profiler.trace_sqlalchemy = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] profiler_jaeger.process_tags = {} {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] profiler_jaeger.service_name_prefix = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] profiler_otlp.service_name_prefix = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_policy.enforce_new_defaults = True {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_policy.enforce_scope = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_policy.policy_default_rule = default {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_policy.policy_file = policy.yaml {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_policy.remote_timeout = 60.0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] privsep_osbrick.group = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] privsep_osbrick.helper_command = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] privsep_osbrick.user = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cinder_sys_admin.group = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cinder_sys_admin.helper_command = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] cinder_sys_admin.user = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] service_user.auth_section = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] service_user.auth_type = password {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] service_user.cafile = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] service_user.certfile = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] service_user.collect_timing = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] service_user.insecure = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] service_user.keyfile = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] service_user.send_service_user_token = True {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] service_user.split_loggers = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] service_user.timeout = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] glance.auth_section = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] glance.auth_type = password {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] glance.certfile = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] glance.collect_timing = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] glance.insecure = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] glance.keyfile = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] glance.region_name = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] glance.split_loggers = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] glance.timeout = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.backend_availability_zone = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.chap_password = **** {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.chap_username = {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.disk_geometry = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.driver_client_cert = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.driver_client_cert_key = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.driver_data_namespace = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.driver_use_ssl = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.enable_unsupported_driver = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.extra_capabilities = {} {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.filter_function = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.goodness_function = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.iscsi_target_flags = {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.iscsi_write_cache = on {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.iser_helper = tgtadm {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.iser_ip_address = 192.168.122.248 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.iser_port = 3260 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.nas_host = {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.nas_login = admin {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.nas_mount_options = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.nas_password = **** {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.nas_private_key = {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.nas_share_path = {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.nas_ssh_port = 22 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.num_shell_tries = 3 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.nvmet_port_id = 1 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.quobyte_client_cfg = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.quobyte_volume_url = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.replication_device = **** {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.report_discard_supported = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.reserved_percentage = 0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.scst_target_driver = iscsi {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.scst_target_iqn_name = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.storage_protocol = iSCSI {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.target_helper = tgtadm {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.target_ip_address = 192.168.122.248 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.target_port = 3260 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.target_protocol = iscsi {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.trace_flags = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.unique_fqdn_network = True {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.use_chap_auth = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.volume_backend_name = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.volume_clear = zero {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.volume_clear_ionice = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.volume_clear_size = 0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_reports.file_event_handler = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_reports.log_dir = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.backend_availability_zone = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.backend_host = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.chap_password = **** {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.chap_username = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.chiscsi_conf = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.disk_geometry = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.driver_client_cert = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.driver_client_cert_key = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.driver_data_namespace = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.driver_use_ssl = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.extra_capabilities = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.filter_function = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.goodness_function = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.iscsi_target_flags = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.iscsi_write_cache = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.iser_helper = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.iser_ip_address = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.iser_port = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.iser_target_prefix = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.nas_host = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.nas_login = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.nas_mount_options = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.nas_password = **** {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.nas_private_key = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.nas_share_path = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.nas_ssh_port = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.num_shell_tries = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.nvmet_ns_id = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.nvmet_port_id = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.replication_device = **** {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.report_discard_supported = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.reserved_percentage = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.scst_target_driver = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.storage_protocol = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.target_helper = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.target_ip_address = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.target_port = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.target_prefix = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.target_protocol = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.trace_flags = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.unique_fqdn_network = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.use_chap_auth = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.volume_clear = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.volume_clear_ionice = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.volume_clear_size = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] QuobyteHD.volumes_dir = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.ssl = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.ssl_version = {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_notifications.driver = [] {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_notifications.retry = -1 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] oslo_messaging_notifications.transport_url = **** {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] key_manager.fixed_key = **** {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] barbican.barbican_api_version = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] barbican.barbican_endpoint = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] barbican.barbican_endpoint_type = public {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] barbican.barbican_region_name = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] barbican.cafile = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] barbican.certfile = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] barbican.collect_timing = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] barbican.insecure = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] barbican.keyfile = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] barbican.number_of_retries = 60 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] barbican.retry_delay = 1 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] barbican.send_service_user_token = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] barbican.split_loggers = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] barbican.timeout = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] barbican.verify_ssl = True {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] barbican.verify_ssl_path = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] barbican_service_user.auth_section = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] barbican_service_user.auth_type = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] barbican_service_user.cafile = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] barbican_service_user.certfile = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] barbican_service_user.collect_timing = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] barbican_service_user.insecure = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] barbican_service_user.keyfile = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] barbican_service_user.split_loggers = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] barbican_service_user.timeout = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] vault.approle_role_id = **** {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] vault.approle_secret_id = **** {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] vault.kv_mountpoint = secret {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] vault.kv_path = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] vault.kv_version = 2 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] vault.namespace = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] vault.root_token_id = **** {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] vault.ssl_ca_crt_file = None {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] vault.timeout = 60.0 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] vault.use_ssl = False {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:37 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] ******************************************************************************** {{(pid=86304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 01:03:37 devstack cinder-volume[86518]: DEBUG cinder.volume.drivers.quobyte [None req-6604197c-f028-4f14-8468-35c926343d15 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86518) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 01:03:37 devstack cinder-volume[86518]: WARNING cinder.volume.drivers.quobyte [None req-6604197c-f028-4f14-8468-35c926343d15 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 01:03:37 devstack cinder-volume[86518]: WARNING cinder.volume.drivers.quobyte [None req-6604197c-f028-4f14-8468-35c926343d15 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 01:03:37 devstack cinder-volume[86518]: DEBUG oslo_concurrency.processutils [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Running cmd (subprocess): mount.quobyte {{(pid=86518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:37 devstack quobyte-client[86521]: Reading configuration file: /etc/quobyte/client.cfg Jul 08 01:03:37 devstack quobyte-client[86521]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 08 01:03:37 devstack cinder-volume[86518]: DEBUG oslo_concurrency.processutils [None req-6604197c-f028-4f14-8468-35c926343d15 None None] CMD "mount.quobyte" returned: 1 in 0.081s {{(pid=86518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:37 devstack cinder-volume[86518]: DEBUG oslo_concurrency.lockutils [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:37 devstack cinder-volume[86518]: DEBUG oslo_concurrency.lockutils [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:37 devstack cinder-volume[86518]: DEBUG cinder.volume.drivers.quobyte [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=86518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:03:37 devstack cinder-volume[86518]: INFO cinder.volume.drivers.quobyte [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d ... Jul 08 01:03:37 devstack cinder-volume[86518]: DEBUG oslo_concurrency.processutils [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 -c /etc/quobyte/client-cinder.cfg {{(pid=86518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:37 devstack sudo[86524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 -c /etc/quobyte/client-cinder.cfg Jul 08 01:03:37 devstack sudo[86524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:38 devstack sudo[86524]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:38 devstack cinder-volume[86518]: DEBUG oslo_concurrency.processutils [None req-6604197c-f028-4f14-8468-35c926343d15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.838s {{(pid=86518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:38 devstack cinder-volume[86518]: INFO cinder.volume.drivers.quobyte [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d succeeded Jul 08 01:03:38 devstack cinder-volume[86518]: DEBUG cinder.volume.drivers.quobyte [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=86518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:03:38 devstack cinder-volume[86518]: DEBUG oslo_concurrency.lockutils [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.853s {{(pid=86518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:38 devstack cinder-volume[86518]: DEBUG oslo_concurrency.processutils [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=86518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:38 devstack sudo[86593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:03:38 devstack sudo[86593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:39 devstack sudo[86593]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:39 devstack cinder-volume[86518]: DEBUG oslo_concurrency.processutils [None req-6604197c-f028-4f14-8468-35c926343d15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.665s {{(pid=86518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:39 devstack cinder-volume[86518]: INFO cinder.volume.driver [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Driver hasn't implemented _init_vendor_properties() Jul 08 01:03:39 devstack cinder-volume[86518]: DEBUG cinder.volume.driver [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5536308288574, 'free_capacity_gb': 1775.5536308288574, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86518) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 01:03:39 devstack cinder-volume[86518]: DEBUG oslo_db.sqlalchemy.engines [None req-6604197c-f028-4f14-8468-35c926343d15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86518) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:03:39 devstack cinder-volume[86518]: DEBUG dbcounter [-] [86518] Writer thread running {{(pid=86518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 01:03:39 devstack cinder-volume[86518]: DEBUG cinder.db.api [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Building query based on filter {{(pid=86518) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 01:03:39 devstack cinder-volume[86518]: DEBUG cinder.image.image_utils [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86518) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 01:03:39 devstack cinder-volume[86518]: INFO cinder.keymgr.migration [None req-44c51ae3-4f3d-4f8e-8448-23441cdd6377 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 01:03:39 devstack cinder-volume[86518]: DEBUG oslo_concurrency.lockutils [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:39 devstack cinder-volume[86518]: DEBUG oslo_concurrency.lockutils [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:39 devstack cinder-volume[86518]: DEBUG cinder.volume.drivers.quobyte [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=86518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:03:39 devstack cinder-volume[86518]: DEBUG cinder.volume.drivers.quobyte [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=86518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:03:39 devstack cinder-volume[86518]: DEBUG oslo_concurrency.lockutils [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:39 devstack cinder-volume[86518]: DEBUG oslo_concurrency.processutils [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=86518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:39 devstack sudo[86596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:03:39 devstack sudo[86596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:40 devstack sudo[86596]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:40 devstack cinder-volume[86518]: DEBUG oslo_concurrency.processutils [None req-6604197c-f028-4f14-8468-35c926343d15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.867s {{(pid=86518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:40 devstack cinder-volume[86518]: DEBUG cinder.manager [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Notifying Schedulers of capabilities ... {{(pid=86518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:03:40 devstack cinder-volume[86518]: INFO cinder.volume.manager [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Driver initialization completed successfully. Jul 08 01:03:40 devstack cinder-volume[86518]: INFO cinder.manager [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Initiating service 3 cleanup Jul 08 01:03:40 devstack cinder-volume[86518]: INFO cinder.manager [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Service 3 cleanup completed. Jul 08 01:03:40 devstack cinder-volume[86518]: DEBUG cinder.service [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Creating RPC server for service cinder-volume {{(pid=86518) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 01:03:40 devstack cinder-volume[86518]: DEBUG cinder.service [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86518) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 01:03:40 devstack cinder-volume[86518]: INFO cinder.volume.manager [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 01:03:40 devstack cinder-volume[86518]: DEBUG oslo_concurrency.lockutils [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:40 devstack cinder-volume[86518]: DEBUG oslo_concurrency.lockutils [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:40 devstack cinder-volume[86518]: DEBUG cinder.volume.drivers.quobyte [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=86518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:03:40 devstack cinder-volume[86518]: DEBUG cinder.volume.drivers.quobyte [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=86518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:03:40 devstack cinder-volume[86518]: DEBUG oslo_concurrency.lockutils [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:40 devstack cinder-volume[86518]: DEBUG oslo_concurrency.processutils [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=86518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:40 devstack sudo[86629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:03:40 devstack sudo[86629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:41 devstack cinder-volume[86518]: DEBUG oslo_concurrency.processutils [None req-6604197c-f028-4f14-8468-35c926343d15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.092s {{(pid=86518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:41 devstack sudo[86629]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:41 devstack cinder-volume[86518]: INFO cinder.volume.manager [None req-6604197c-f028-4f14-8468-35c926343d15 None None] Driver post RPC initialization completed successfully. Jul 08 01:03:44 devstack cinder-volume[86518]: DEBUG oslo_concurrency.lockutils [None req-b3e12f39-521d-4457-bfdb-610820baa54d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:44 devstack cinder-volume[86518]: DEBUG oslo_concurrency.lockutils [None req-b3e12f39-521d-4457-bfdb-610820baa54d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:44 devstack cinder-volume[86518]: DEBUG cinder.volume.drivers.quobyte [None req-b3e12f39-521d-4457-bfdb-610820baa54d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=86518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:03:44 devstack cinder-volume[86518]: DEBUG cinder.volume.drivers.quobyte [None req-b3e12f39-521d-4457-bfdb-610820baa54d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=86518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:03:44 devstack cinder-volume[86518]: DEBUG oslo_concurrency.lockutils [None req-b3e12f39-521d-4457-bfdb-610820baa54d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:44 devstack cinder-volume[86518]: DEBUG oslo_concurrency.processutils [None req-b3e12f39-521d-4457-bfdb-610820baa54d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=86518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:44 devstack sudo[86717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:03:44 devstack sudo[86717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:45 devstack sudo[86717]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:45 devstack cinder-volume[86518]: DEBUG oslo_concurrency.processutils [None req-b3e12f39-521d-4457-bfdb-610820baa54d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.646s {{(pid=86518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:45 devstack cinder-volume[86518]: DEBUG cinder.manager [None req-b3e12f39-521d-4457-bfdb-610820baa54d None None] Notifying Schedulers of capabilities ... {{(pid=86518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:03:47 devstack cinder-volume[86304]: DEBUG dbcounter [-] [86304] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86304) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:03:47 devstack cinder-volume[86304]: INFO oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] Caught SIGTERM, stopping children Jul 08 01:03:47 devstack cinder-volume[86304]: DEBUG oslo_concurrency.lockutils [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] Acquiring lock "singleton_lock" {{(pid=86304) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 01:03:47 devstack cinder-volume[86304]: DEBUG oslo_concurrency.lockutils [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] Acquired lock "singleton_lock" {{(pid=86304) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 01:03:47 devstack cinder-volume[86304]: DEBUG oslo_concurrency.lockutils [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] Releasing lock "singleton_lock" {{(pid=86304) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 01:03:47 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] Stop services. {{(pid=86304) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 01:03:47 devstack cinder-volume[86304]: DEBUG oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] Killing children. {{(pid=86304) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 01:03:47 devstack cinder-volume[86304]: INFO oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] Waiting on 1 children to exit Jul 08 01:03:48 devstack cinder-volume[86518]: DEBUG oslo_concurrency.lockutils [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] Acquiring lock "singleton_lock" {{(pid=86518) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 01:03:48 devstack cinder-volume[86518]: DEBUG oslo_concurrency.lockutils [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] Acquired lock "singleton_lock" {{(pid=86518) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 01:03:48 devstack cinder-volume[86518]: DEBUG oslo_concurrency.lockutils [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] Releasing lock "singleton_lock" {{(pid=86518) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 01:03:48 devstack cinder-volume[86518]: WARNING amqp [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 01:03:49 devstack cinder-volume[86518]: WARNING amqp [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 01:03:49 devstack cinder-volume[86304]: INFO oslo_service.backend._eventlet.service [None req-9d0fdb65-9911-46f4-a25e-4bb18bf5c60f None None] Child 86518 exited with status 0 Jul 08 01:03:49 devstack cinder-volume[86794]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 01:03:49 devstack cinder-volume[86794]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 01:03:49 devstack cinder-volume[86794]: we strongly recommend against using it for new projects. Jul 08 01:03:49 devstack cinder-volume[86794]: If you are already using Eventlet, we recommend migrating to a different Jul 08 01:03:49 devstack cinder-volume[86794]: framework. For more detail see Jul 08 01:03:49 devstack cinder-volume[86794]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 01:03:49 devstack cinder-volume[86794]: import eventlet # noqa Jul 08 01:03:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86794) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 01:03:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86794) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 01:03:52 devstack cinder-volume[86794]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86794) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 01:03:53 devstack cinder-volume[86794]: INFO dbcounter [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] Registered counter for database cinder Jul 08 01:03:53 devstack cinder-volume[86794]: DEBUG oslo_db.sqlalchemy.engines [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86794) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:03:53 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writer thread running {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 01:03:53 devstack cinder-volume[86794]: INFO cinder.rpc [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 01:03:53 devstack cinder-volume[86794]: INFO cinder.rpc [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 01:03:53 devstack cinder-volume[86794]: DEBUG oslo_db.sqlalchemy.engines [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86794) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:03:54 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] Determined volume DB was empty at startup. Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG cinder.volume.manager [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86794) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 01:03:54 devstack cinder-volume[86794]: WARNING stevedore.named [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 01:03:54 devstack cinder-volume[86794]: WARNING castellan.key_manager [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 01:03:54 devstack cinder-volume[86794]: WARNING cinder.keymgr.conf_key_mgr [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 01:03:54 devstack cinder-volume[86794]: INFO cinder.volume.manager [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_db.sqlalchemy.engines [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86794) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:03:54 devstack cinder-volume[86794]: INFO oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] Starting 1 workers Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] Started child 87022 {{(pid=86794) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] Full set of CONF: {{(pid=86794) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] ******************************************************************************** {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] Configuration options gathered from: {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] ================================================================================ {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] allow_availability_zone_fallback = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[87022]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] allow_compression_on_image_upload = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] allowed_direct_url_schemes = [] {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] api_rate_limit = True {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] auth_strategy = keystone {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_availability_zone = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_host = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_name = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_stats_polling_interval = 60 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backup_api_class = cinder.backup.api.API {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backup_name_template = backup-%s {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backup_use_same_host = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backup_use_temp_snapshot = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] chap_password = **** {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] chap_username = {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cinder_internal_tenant_project_id = 8252f93eae2d42db9079609249c2a9e9 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cinder_internal_tenant_user_id = bd5d3620af36410aaba8231eb8116640 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cluster = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] compression_format = gzip {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] compute_api_class = cinder.compute.nova.API {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] config_dir = [] {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] config_source = [] {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] control_exchange = openstack {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] debug = True {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] default_availability_zone = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] default_group_type = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] default_volume_type = QuobyteHD {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] disk_geometry = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] driver_client_cert = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] driver_client_cert_key = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] driver_data_namespace = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] driver_ssl_cert_path = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] driver_ssl_cert_verify = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] driver_use_ssl = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] enable_new_services = True {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] enable_unsupported_driver = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] enabled_backends = ['QuobyteHD'] {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] enforce_multipath_for_image_xfer = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] filter_function = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] glance_api_insecure = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] glance_api_servers = ['http://192.168.122.248/image'] {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] glance_api_ssl_compression = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] glance_ca_certificates_file = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] glance_catalog_info = image:glance:publicURL {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] glance_certfile = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] glance_keyfile = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] glance_num_retries = 3 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] glance_request_timeout = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] goodness_function = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] graceful_shutdown_timeout = 5 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] group_api_class = cinder.group.api.API {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] host = devstack {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] image_compress_on_upload = True {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] image_conversion_address_space_limit = 1 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] image_conversion_cpu_limit = 60 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] image_conversion_disable = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] image_upload_use_cinder_backend = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] image_upload_use_internal_tenant = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] image_volume_cache_enabled = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] image_volume_cache_max_count = 0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] image_volume_cache_max_size_gb = 0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] init_host_max_objects_retrieval = 0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] instance_format = [instance: %(uuid)s] {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] iscsi_target_flags = {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] iscsi_write_cache = on {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] iser_helper = tgtadm {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] iser_ip_address = 192.168.122.248 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] iser_port = 3260 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] log_color = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] log_config_append = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] log_dir = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] log_file = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] log_options = True {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] log_rotate_interval = 1 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] log_rotate_interval_type = days {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] log_rotation_type = none {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] max_age = 0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] max_logfile_count = 30 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] max_logfile_size_mb = 200 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] max_over_subscription_ratio = 20.0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] message_reap_interval = 86400 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] message_ttl = 2592000 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] migration_create_volume_timeout_secs = 300 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] monkey_patch = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] monkey_patch_modules = [] {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] my_ip = 192.168.122.248 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] no_snapshot_gb_quota = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] num_iser_scan_tries = 3 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] num_shell_tries = 3 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] num_volume_device_scan_tries = 3 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] nvmeof_conn_info_version = 1 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] nvmet_ns_id = 10 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] nvmet_port_id = 1 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] osapi_max_limit = 1000 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] osapi_volume_ext_list = [] {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] osapi_volume_listen = 0.0.0.0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] osapi_volume_listen_port = 8776 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] osapi_volume_use_ssl = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] osapi_volume_workers = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] per_volume_size_limit = -1 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] periodic_fuzzy_delay = 60 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] periodic_interval = 60 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] project_id_regex = [0-9a-f\-]+ {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] public_endpoint = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87022) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] publish_errors = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] quota_backup_gigabytes = 1000 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] quota_backups = 10 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] quota_gigabytes = 1000 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] quota_groups = 10 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] quota_snapshots = 10 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] quota_volumes = 10 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] rate_limit_burst = 0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] rate_limit_except_level = CRITICAL {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] rate_limit_interval = 0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] reinit_driver_count = 3 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] replication_device = **** {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] report_discard_supported = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] report_interval = 120 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] reservation_clean_interval = 86400 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] reservation_expire = 86400 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] reserved_image_namespaces = [] {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] reserved_percentage = 0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] rpc_response_timeout = 120 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] run_external_periodic_tasks = True {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] scst_target_driver = iscsi {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] scst_target_iqn_name = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] service_down_time = 720 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] shell_completion = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] snapshot_name_template = snapshot-%s {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] split_loggers = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] state_path = /opt/stack/data/cinder {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] storage_availability_zone = nova {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] storage_protocol = iSCSI {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] syslog_log_facility = LOG_USER {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] target_helper = lioadm {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] target_ip_address = 192.168.122.248 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] target_port = 3260 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] target_protocol = iscsi {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] target_secondary_ip_addresses = [] {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] trace_flags = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] transfer_api_class = cinder.transfer.api.API {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] transport_url = **** {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] until_refresh = 0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] use_chap_auth = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] use_default_quota_class = True {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] use_journal = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] use_json = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] use_multipath_for_image_xfer = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] use_stderr = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] use_syslog = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] verify_glance_signatures = enabled {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] volume_api_class = cinder.volume.api.API {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] volume_backend_name = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] volume_clear = zero {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] volume_clear_ionice = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] volume_clear_size = 0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] volume_copy_bps_limit = 0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] volume_dd_blocksize = 1M {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] volume_name_template = volume-%s {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] volume_service_inithost_offload = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] volume_usage_audit_period = month {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] zoning_mode = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_concurrency.disable_process_locking = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87022) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.quobyte [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 01:03:54 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.quobyte [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 01:03:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Running cmd (subprocess): mount.quobyte {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.auth_section = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.auth_type = password {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.auth_version = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.cache = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.certfile = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.delay_auth_decision = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.http_connect_timeout = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.include_service_catalog = True {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.insecure = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.interface = public {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.keyfile = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.memcache_password = {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.memcache_username = {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.region_name = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.service_token_roles_required = True {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.service_type = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.token_cache_time = 300 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.248/identity {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.backend = dogpile.cache.null {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.backend_argument = **** {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.backend_expiration_time = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.config_prefix = cache.oslo {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.debug_cache_backend = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.enable_retry_client = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.enable_socket_keepalive = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.enabled = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.expiration_time = 600 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.hashclient_retry_attempts = 2 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.memcache_dead_retry = 300 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.memcache_pool_maxsize = 10 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.memcache_sasl_enabled = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.password = **** {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.proxies = [] {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.redis_db = 0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.redis_sentinel_service_name = mymaster {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.redis_server = localhost:6379 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] CMD "mount.quobyte" returned: 1 in 0.049s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.retry_attempts = 2 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.retry_delay = 0.0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.socket_keepalive_count = 1 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.socket_keepalive_idle = 1 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.socket_keepalive_interval = 1 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.socket_timeout = 1.0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.tls_allowed_ciphers = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.tls_cafile = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.tls_certfile = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.tls_enabled = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.tls_keyfile = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cache.username = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] coordination.backend_url = **** {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] database.asyncio_connection = **** {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] database.asyncio_slave_connection = **** {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] database.backend = sqlalchemy {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] database.connection = **** {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] database.connection_debug = 0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] database.connection_parameters = {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] database.connection_recycle_time = 3600 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] database.connection_trace = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] database.db_inc_retry_interval = True {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] database.db_max_retries = 20 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] database.db_max_retry_interval = 10 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] database.db_retry_interval = 1 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] database.max_overflow = 50 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] database.max_pool_size = 5 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] database.max_retries = 10 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] database.mysql_wsrep_sync_wait = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] database.pool_timeout = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] database.retry_interval = 10 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] database.slave_connection = **** {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] database.sqlite_synchronous = True {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] database.synchronous_reader = True {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] database.use_db_reconnect = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] profiler.connection_string = messaging:// {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] profiler.enabled = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] profiler.es_doc_type = notification {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] profiler.es_scroll_size = 10000 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] profiler.es_scroll_time = 2m {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] profiler.filter_error_trace = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] profiler.hmac_keys = **** {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] profiler.sentinel_service_name = mymaster {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] profiler.socket_timeout = 0.1 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] profiler.trace_requests = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:03:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] profiler.trace_sqlalchemy = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] profiler_jaeger.process_tags = {} {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] profiler_jaeger.service_name_prefix = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] profiler_otlp.service_name_prefix = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_policy.enforce_new_defaults = True {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_policy.enforce_scope = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_policy.policy_default_rule = default {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_policy.policy_file = policy.yaml {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_policy.remote_timeout = 60.0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] privsep_osbrick.group = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] privsep_osbrick.helper_command = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] privsep_osbrick.user = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cinder_sys_admin.group = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cinder_sys_admin.helper_command = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] cinder_sys_admin.user = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] service_user.auth_section = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] service_user.auth_type = password {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] service_user.cafile = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] service_user.certfile = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] service_user.collect_timing = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] service_user.insecure = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] service_user.keyfile = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] service_user.send_service_user_token = True {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] service_user.split_loggers = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] service_user.timeout = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] glance.auth_section = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] glance.auth_type = password {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] glance.certfile = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] glance.collect_timing = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] glance.insecure = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] glance.keyfile = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] glance.region_name = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] glance.split_loggers = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] glance.timeout = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.backend_availability_zone = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.chap_password = **** {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.chap_username = {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.disk_geometry = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.driver_client_cert = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.driver_client_cert_key = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.driver_data_namespace = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack sudo[87042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.driver_use_ssl = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.enable_unsupported_driver = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.extra_capabilities = {} {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.filter_function = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.goodness_function = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack sudo[87042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.iscsi_target_flags = {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.iscsi_write_cache = on {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.iser_helper = tgtadm {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.iser_ip_address = 192.168.122.248 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.iser_port = 3260 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.nas_host = {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.nas_login = admin {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.nas_mount_options = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.nas_password = **** {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.nas_private_key = {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.nas_share_path = {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.nas_ssh_port = 22 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.num_shell_tries = 3 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.nvmet_port_id = 1 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.quobyte_client_cfg = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.quobyte_volume_url = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.replication_device = **** {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.report_discard_supported = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.reserved_percentage = 0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.scst_target_driver = iscsi {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.scst_target_iqn_name = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.storage_protocol = iSCSI {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.target_helper = tgtadm {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.target_ip_address = 192.168.122.248 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.target_port = 3260 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.target_protocol = iscsi {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.trace_flags = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.unique_fqdn_network = True {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.use_chap_auth = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.volume_backend_name = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.volume_clear = zero {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.volume_clear_ionice = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.volume_clear_size = 0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_reports.file_event_handler = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_reports.log_dir = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.backend_availability_zone = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.backend_host = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.chap_password = **** {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.chap_username = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.chiscsi_conf = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.disk_geometry = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.driver_client_cert = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.driver_client_cert_key = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.driver_data_namespace = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.driver_use_ssl = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.extra_capabilities = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.filter_function = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.goodness_function = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.iscsi_target_flags = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.iscsi_write_cache = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.iser_helper = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.iser_ip_address = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.iser_port = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.iser_target_prefix = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.nas_host = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.nas_login = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.nas_mount_options = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.nas_password = **** {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.nas_private_key = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.nas_share_path = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.nas_ssh_port = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.num_shell_tries = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.nvmet_ns_id = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.nvmet_port_id = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.replication_device = **** {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.report_discard_supported = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.reserved_percentage = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.scst_target_driver = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.storage_protocol = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.target_helper = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.target_ip_address = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.target_port = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.target_prefix = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.target_protocol = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.trace_flags = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.unique_fqdn_network = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.use_chap_auth = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.volume_clear = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.volume_clear_ionice = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.volume_clear_size = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] QuobyteHD.volumes_dir = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.ssl = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.ssl_version = {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_notifications.driver = [] {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_notifications.retry = -1 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] oslo_messaging_notifications.transport_url = **** {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] key_manager.fixed_key = **** {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] barbican.barbican_api_version = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] barbican.barbican_endpoint = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] barbican.barbican_endpoint_type = public {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] barbican.barbican_region_name = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] barbican.cafile = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] barbican.certfile = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] barbican.collect_timing = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] barbican.insecure = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] barbican.keyfile = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] barbican.number_of_retries = 60 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] barbican.retry_delay = 1 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] barbican.send_service_user_token = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] barbican.split_loggers = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] barbican.timeout = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] barbican.verify_ssl = True {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] barbican.verify_ssl_path = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] barbican_service_user.auth_section = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] barbican_service_user.auth_type = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] barbican_service_user.cafile = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] barbican_service_user.certfile = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] barbican_service_user.collect_timing = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] barbican_service_user.insecure = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] barbican_service_user.keyfile = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] barbican_service_user.split_loggers = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] barbican_service_user.timeout = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] vault.approle_role_id = **** {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] vault.approle_secret_id = **** {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] vault.kv_mountpoint = secret {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] vault.kv_path = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] vault.kv_version = 2 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] vault.namespace = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] vault.root_token_id = **** {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] vault.ssl_ca_crt_file = None {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] vault.timeout = 60.0 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] vault.use_ssl = False {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:03:54 devstack cinder-volume[86794]: DEBUG oslo_service.backend._eventlet.service [None req-a2034a97-b3e7-409e-b891-423a7661324a None None] ******************************************************************************** {{(pid=86794) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 01:03:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.986s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:55 devstack cinder-volume[87022]: INFO cinder.volume.driver [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Driver hasn't implemented _init_vendor_properties() Jul 08 01:03:55 devstack cinder-volume[87022]: DEBUG cinder.volume.driver [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.597396850586, 'free_capacity_gb': 1775.597396850586, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87022) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 01:03:55 devstack sudo[87042]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:55 devstack cinder-volume[87022]: DEBUG oslo_db.sqlalchemy.engines [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87022) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:03:55 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writer thread running {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 01:03:55 devstack cinder-volume[87022]: DEBUG cinder.db.api [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Building query based on filter {{(pid=87022) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 01:03:55 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87022) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 01:03:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:55 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:03:55 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:03:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:55 devstack cinder-volume[87022]: INFO cinder.keymgr.migration [None req-29305173-abad-4456-89dc-628953f747bf None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 01:03:55 devstack sudo[87082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:03:55 devstack sudo[87082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:56 devstack sudo[87082]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.701s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:56 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:03:56 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Driver initialization completed successfully. Jul 08 01:03:56 devstack cinder-volume[87022]: INFO cinder.manager [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Initiating service 3 cleanup Jul 08 01:03:56 devstack cinder-volume[87022]: INFO cinder.manager [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Service 3 cleanup completed. Jul 08 01:03:56 devstack cinder-volume[87022]: DEBUG cinder.service [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Creating RPC server for service cinder-volume {{(pid=87022) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 01:03:56 devstack cinder-volume[87022]: DEBUG cinder.service [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87022) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 01:03:56 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 01:03:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:56 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:03:56 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:03:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:56 devstack sudo[87131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:03:56 devstack sudo[87131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:57 devstack sudo[87131]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.648s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:57 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-32ac2410-4180-42a8-9c78-3acd3c111595 None None] Driver post RPC initialization completed successfully. Jul 08 01:04:04 devstack cinder-volume[86794]: DEBUG dbcounter [-] [86794] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:04:06 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:04:07 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=3 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:04:45 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:04:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread count: 6 {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:04:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread info: [<_MainThread(MainThread, started 134382216167552)>, , , , , ] {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:04:56 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:04:56 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Flow 'volume_create_manager' (54a571ab-6407-4287-9ac0-c4b7e8d9ceb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:04:56 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc5cde3-8cd9-434a-bda4-09549bd1027e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:56 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc5cde3-8cd9-434a-bda4-09549bd1027e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-717375018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f85e5bdb-b06d-46a0-a14f-075d1197e714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea208f6de7f845679ae00973062b3a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:04:57Z,use_quota=True,user_id='c822c06e310e451d90649b58446e95db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:56 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54cf1326-a12b-4328-955a-62564da3d88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:56 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54cf1326-a12b-4328-955a-62564da3d88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:56 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fdc87eb-059d-4de3-bab7-285d5e4e3ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:56 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fdc87eb-059d-4de3-bab7-285d5e4e3ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f85e5bdb-b06d-46a0-a14f-075d1197e714', 'volume_name': 'volume-f85e5bdb-b06d-46a0-a14f-075d1197e714', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:56 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (856a513e-89c6-4f23-8e1f-d45d1d1848da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:56 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (856a513e-89c6-4f23-8e1f-d45d1d1848da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:56 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b922840-a38c-456d-8050-fcedafb07c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:56 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Volume f85e5bdb-b06d-46a0-a14f-075d1197e714: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f85e5bdb-b06d-46a0-a14f-075d1197e714', 'volume_size': 1} Jul 08 01:04:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:04:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:04:56 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-717375018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f85e5bdb-b06d-46a0-a14f-075d1197e714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea208f6de7f845679ae00973062b3a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:04:57Z,use_quota=True,user_id='c822c06e310e451d90649b58446e95db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:04:56 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Creating volume f85e5bdb-b06d-46a0-a14f-075d1197e714 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:04:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:04:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:04:56 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:04:56 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:04:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:04:56 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:04:56 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:04:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f85e5bdb-b06d-46a0-a14f-075d1197e714 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:57 devstack sudo[87476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f85e5bdb-b06d-46a0-a14f-075d1197e714 1073741824 Jul 08 01:04:57 devstack sudo[87476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:58 devstack sudo[87476]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f85e5bdb-b06d-46a0-a14f-075d1197e714 1073741824" returned: 0 in 1.507s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f85e5bdb-b06d-46a0-a14f-075d1197e714 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:58 devstack sudo[87827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f85e5bdb-b06d-46a0-a14f-075d1197e714 Jul 08 01:04:58 devstack sudo[87827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:59 devstack sudo[87827]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f85e5bdb-b06d-46a0-a14f-075d1197e714" returned: 0 in 0.963s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] <== create_volume: return (2553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:04:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.556s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:04:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b922840-a38c-456d-8050-fcedafb07c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f85e5bdb-b06d-46a0-a14f-075d1197e714', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9728fe9f-b0ed-4182-a953-f561d34c158b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:59 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Volume volume-f85e5bdb-b06d-46a0-a14f-075d1197e714 (f85e5bdb-b06d-46a0-a14f-075d1197e714): created successfully Jul 08 01:04:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9728fe9f-b0ed-4182-a953-f561d34c158b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Flow 'volume_create_manager' (54a571ab-6407-4287-9ac0-c4b7e8d9ceb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:04:59 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-67829c19-4333-481e-a9cc-55d9114e1b69 tempest-TaggedAttachmentsTest-1981396856 None] Created volume successfully. Jul 08 01:05:09 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:UPDATE=5,cinder:SELECT=1 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:05:09 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:05:29 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:05:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Flow 'volume_create_manager' (211ca6bb-f9c1-4d81-8e7d-21b1cb216af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:05:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89fd3a67-0557-4843-ba2c-08807260bce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89fd3a67-0557-4843-ba2c-08807260bce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-8504758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f48073d8-83bb-4ea8-ad5c-be4327644dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29492ed2aa714d628412ecd336bb557a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:05:30Z,use_quota=True,user_id='98598983e91d454dbc82a565b7482021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e6d88b-1088-476f-bca9-22a8f46ac798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e6d88b-1088-476f-bca9-22a8f46ac798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d8a33f-423f-40a1-b2d7-d7dd5bf55664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d8a33f-423f-40a1-b2d7-d7dd5bf55664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f48073d8-83bb-4ea8-ad5c-be4327644dd9', 'volume_name': 'volume-f48073d8-83bb-4ea8-ad5c-be4327644dd9', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a93aaafd-3b91-4e37-bc1a-df35acf284f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a93aaafd-3b91-4e37-bc1a-df35acf284f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840ff9bd-ea4c-402d-b748-4390856d953c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:29 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Volume f48073d8-83bb-4ea8-ad5c-be4327644dd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f48073d8-83bb-4ea8-ad5c-be4327644dd9', 'volume_size': 1} Jul 08 01:05:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-8504758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f48073d8-83bb-4ea8-ad5c-be4327644dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29492ed2aa714d628412ecd336bb557a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:05:30Z,use_quota=True,user_id='98598983e91d454dbc82a565b7482021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:05:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Creating volume f48073d8-83bb-4ea8-ad5c-be4327644dd9 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:05:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:05:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:05:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:05:29 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:05:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f48073d8-83bb-4ea8-ad5c-be4327644dd9 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:29 devstack sudo[88084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f48073d8-83bb-4ea8-ad5c-be4327644dd9 1073741824 Jul 08 01:05:29 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:31 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f48073d8-83bb-4ea8-ad5c-be4327644dd9 1073741824" returned: 0 in 1.315s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f48073d8-83bb-4ea8-ad5c-be4327644dd9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:31 devstack sudo[88093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f48073d8-83bb-4ea8-ad5c-be4327644dd9 Jul 08 01:05:31 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:32 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f48073d8-83bb-4ea8-ad5c-be4327644dd9" returned: 0 in 0.939s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:32 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] <== create_volume: return (2326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:05:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.330s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:32 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840ff9bd-ea4c-402d-b748-4390856d953c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f48073d8-83bb-4ea8-ad5c-be4327644dd9', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:32 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd8168a0-8be3-4610-b5db-42b864f56110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:32 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Volume volume-f48073d8-83bb-4ea8-ad5c-be4327644dd9 (f48073d8-83bb-4ea8-ad5c-be4327644dd9): created successfully Jul 08 01:05:32 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd8168a0-8be3-4610-b5db-42b864f56110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:32 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Flow 'volume_create_manager' (211ca6bb-f9c1-4d81-8e7d-21b1cb216af9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:05:32 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-8ae017fa-85be-47fe-a611-a98277edce2c tempest-DeleteServersTestJSON-1857914509 None] Created volume successfully. Jul 08 01:05:41 devstack cinder-volume[87022]: WARNING py.warnings [req-6677ffba-8246-4bdf-9306-83739a2d42d3 req-3a5ae804-2217-4bf7-85dc-76bfc4220dab tempest-DeleteServersTestJSON-1857914509 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 08 01:05:41 devstack cinder-volume[87022]: .first() Jul 08 01:05:41 devstack cinder-volume[87022]: Jul 08 01:05:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-6677ffba-8246-4bdf-9306-83739a2d42d3 req-3a5ae804-2217-4bf7-85dc-76bfc4220dab tempest-DeleteServersTestJSON-1857914509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-6677ffba-8246-4bdf-9306-83739a2d42d3 req-3a5ae804-2217-4bf7-85dc-76bfc4220dab tempest-DeleteServersTestJSON-1857914509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:41 devstack cinder-volume[87022]: INFO oslo.privsep.daemon [req-6677ffba-8246-4bdf-9306-83739a2d42d3 req-3a5ae804-2217-4bf7-85dc-76bfc4220dab tempest-DeleteServersTestJSON-1857914509 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpoapfbg5d/privsep.sock'] Jul 08 01:05:41 devstack sudo[88286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpoapfbg5d/privsep.sock Jul 08 01:05:41 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:42 devstack cinder-volume[87022]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 08 01:05:42 devstack cinder-volume[87022]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 01:05:42 devstack cinder-volume[87022]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 01:05:42 devstack cinder-volume[87022]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 01:05:42 devstack cinder-volume[87022]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 01:05:42 devstack cinder-volume[87022]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 01:05:42 devstack cinder-volume[87022]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 01:05:42 devstack cinder-volume[87022]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 01:05:42 devstack cinder-volume[87022]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 08 01:05:43 devstack cinder-volume[87022]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 08 01:05:43 devstack cinder-volume[87022]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 01:05:43 devstack cinder-volume[87022]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 01:05:43 devstack cinder-volume[87022]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 01:05:43 devstack cinder-volume[87022]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 01:05:43 devstack cinder-volume[87022]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 01:05:43 devstack cinder-volume[87022]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 01:05:43 devstack cinder-volume[87022]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 01:05:43 devstack cinder-volume[87022]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 08 01:05:44 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:44 devstack cinder-volume[87022]: INFO oslo.privsep.daemon [req-6677ffba-8246-4bdf-9306-83739a2d42d3 req-3a5ae804-2217-4bf7-85dc-76bfc4220dab tempest-DeleteServersTestJSON-1857914509 None] Spawned new privsep daemon via rootwrap Jul 08 01:05:44 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [req-6677ffba-8246-4bdf-9306-83739a2d42d3 req-3a5ae804-2217-4bf7-85dc-76bfc4220dab tempest-DeleteServersTestJSON-1857914509 None] Accepted privsep connection to /tmp/tmpoapfbg5d/privsep.sock {{(pid=87022) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 08 01:05:44 devstack cinder-volume[87022]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 08 01:05:44 devstack cinder-volume[87022]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 08 01:05:44 devstack cinder-volume[87022]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 08 01:05:44 devstack cinder-volume[87022]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88290 Jul 08 01:05:44 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed43ddfe-dcaf-4a3c-9378-ba86700d16ad]: (2,) {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:05:44 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[54735099-92de-41b5-96ea-685b01eaeabf]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:05:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-6677ffba-8246-4bdf-9306-83739a2d42d3 req-3a5ae804-2217-4bf7-85dc-76bfc4220dab tempest-DeleteServersTestJSON-1857914509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f48073d8-83bb-4ea8-ad5c-be4327644dd9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:44 devstack sudo[88292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f48073d8-83bb-4ea8-ad5c-be4327644dd9 Jul 08 01:05:44 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:45 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:05:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:05:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:05:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:45 devstack sudo[88295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:05:45 devstack sudo[88295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:46 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-6677ffba-8246-4bdf-9306-83739a2d42d3 req-3a5ae804-2217-4bf7-85dc-76bfc4220dab tempest-DeleteServersTestJSON-1857914509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f48073d8-83bb-4ea8-ad5c-be4327644dd9" returned: 0 in 1.786s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-6677ffba-8246-4bdf-9306-83739a2d42d3 req-3a5ae804-2217-4bf7-85dc-76bfc4220dab tempest-DeleteServersTestJSON-1857914509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 4.902s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-6677ffba-8246-4bdf-9306-83739a2d42d3 req-3a5ae804-2217-4bf7-85dc-76bfc4220dab tempest-DeleteServersTestJSON-1857914509 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d', 'name': 'volume-f48073d8-83bb-4ea8-ad5c-be4327644dd9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a2d1b27c-4e79-4c9a-aa9a-05ecdaea25a4', 'enforce_multipath': True} {{(pid=87022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:05:46 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-6677ffba-8246-4bdf-9306-83739a2d42d3 req-3a5ae804-2217-4bf7-85dc-76bfc4220dab tempest-DeleteServersTestJSON-1857914509 None] attachment_update completed successfully. Jul 08 01:05:46 devstack sudo[88295]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.584s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:46 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:05:47 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:05:47 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread count: 8 {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:05:47 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread info: [<_MainThread(MainThread, started 134382216167552)>, , , , , , , ] {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:05:56 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=7,cinder:UPDATE=6 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:05:56 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:05:57 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-1037f7f4-184e-4958-8774-9f472e4f87a2 req-188a3dc9-0519-4e88-82d5-ca0377950b72 tempest-DeleteServersTestJSON-1857914509 None] Terminate volume connection completed successfully. Jul 08 01:05:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-1037f7f4-184e-4958-8774-9f472e4f87a2 req-188a3dc9-0519-4e88-82d5-ca0377950b72 tempest-DeleteServersTestJSON-1857914509 None] Deleting attachment a2d1b27c-4e79-4c9a-aa9a-05ecdaea25a4. {{(pid=87022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:05:58 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:05:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Flow 'volume_create_manager' (2f474386-86d8-430c-9ddc-f78e6d4cb9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:05:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b3ec1fe-4be4-41b0-9b8a-e45cce307fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b3ec1fe-4be4-41b0-9b8a-e45cce307fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-432118436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ca69bf4-71ee-4ac6-9c18-b74cbc00eecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadb6d0b2e2a4aa4a8c90b556a9f0cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:05:58Z,use_quota=True,user_id='b79c59b1a9294424891a6de9dcc62b4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e150f41-37e2-482d-8f71-b38797f76a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e150f41-37e2-482d-8f71-b38797f76a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf1b4f1-18a5-4ad0-a0c7-63915b3e9b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf1b4f1-18a5-4ad0-a0c7-63915b3e9b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ca69bf4-71ee-4ac6-9c18-b74cbc00eecb', 'volume_name': 'volume-1ca69bf4-71ee-4ac6-9c18-b74cbc00eecb', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f33184-7181-4ec5-afca-4090aafca82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f33184-7181-4ec5-afca-4090aafca82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6910a1f1-00da-4b3d-8ad3-c00077d88f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:58 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Volume 1ca69bf4-71ee-4ac6-9c18-b74cbc00eecb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ca69bf4-71ee-4ac6-9c18-b74cbc00eecb', 'volume_size': 1} Jul 08 01:05:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-432118436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ca69bf4-71ee-4ac6-9c18-b74cbc00eecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadb6d0b2e2a4aa4a8c90b556a9f0cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:05:58Z,use_quota=True,user_id='b79c59b1a9294424891a6de9dcc62b4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:05:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Creating volume 1ca69bf4-71ee-4ac6-9c18-b74cbc00eecb {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:05:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:05:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:05:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:05:58 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:05:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1ca69bf4-71ee-4ac6-9c18-b74cbc00eecb 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:58 devstack sudo[88831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1ca69bf4-71ee-4ac6-9c18-b74cbc00eecb 1073741824 Jul 08 01:05:58 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:59 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1ca69bf4-71ee-4ac6-9c18-b74cbc00eecb 1073741824" returned: 0 in 1.554s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1ca69bf4-71ee-4ac6-9c18-b74cbc00eecb {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:00 devstack sudo[88839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1ca69bf4-71ee-4ac6-9c18-b74cbc00eecb Jul 08 01:06:00 devstack sudo[88839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:01 devstack sudo[88839]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1ca69bf4-71ee-4ac6-9c18-b74cbc00eecb" returned: 0 in 0.968s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] <== create_volume: return (2603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:06:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.606s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:06:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6910a1f1-00da-4b3d-8ad3-c00077d88f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ca69bf4-71ee-4ac6-9c18-b74cbc00eecb', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:06:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c996e152-493e-4561-80ae-8482371202f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:06:01 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Volume volume-1ca69bf4-71ee-4ac6-9c18-b74cbc00eecb (1ca69bf4-71ee-4ac6-9c18-b74cbc00eecb): created successfully Jul 08 01:06:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c996e152-493e-4561-80ae-8482371202f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:06:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Flow 'volume_create_manager' (2f474386-86d8-430c-9ddc-f78e6d4cb9b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:06:01 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-242d524f-63ac-4c64-8b61-517f25fdc0c2 tempest-VolumesAdminNegativeTest-1552184501 None] Created volume successfully. Jul 08 01:06:02 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-56ca3a97-cd4e-425b-8d01-28aff465de33 tempest-DeleteServersTestJSON-1857914509 None] Acquiring lock "cinder-f48073d8-83bb-4ea8-ad5c-be4327644dd9-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:06:02 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-56ca3a97-cd4e-425b-8d01-28aff465de33 tempest-DeleteServersTestJSON-1857914509 None] Lock "cinder-f48073d8-83bb-4ea8-ad5c-be4327644dd9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:06:02 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2c99f953-61b4-423b-9dcc-c2e6ad812b12 tempest-VolumesAdminNegativeTest-1552184501 None] Acquiring lock "cinder-1ca69bf4-71ee-4ac6-9c18-b74cbc00eecb-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:06:02 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2c99f953-61b4-423b-9dcc-c2e6ad812b12 tempest-VolumesAdminNegativeTest-1552184501 None] Lock "cinder-1ca69bf4-71ee-4ac6-9c18-b74cbc00eecb-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:06:03 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-56ca3a97-cd4e-425b-8d01-28aff465de33 tempest-DeleteServersTestJSON-1857914509 None] Acquiring lock "cinder-quobyte-f48073d8-83bb-4ea8-ad5c-be4327644dd9" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:06:03 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-56ca3a97-cd4e-425b-8d01-28aff465de33 tempest-DeleteServersTestJSON-1857914509 None] Lock "cinder-quobyte-f48073d8-83bb-4ea8-ad5c-be4327644dd9" acquired by "delete_volume" :: waited 0.037s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:06:03 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[206b2969-8029-4210-ab11-2c64e56e8d19]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:06:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-56ca3a97-cd4e-425b-8d01-28aff465de33 tempest-DeleteServersTestJSON-1857914509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f48073d8-83bb-4ea8-ad5c-be4327644dd9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:03 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2c99f953-61b4-423b-9dcc-c2e6ad812b12 tempest-VolumesAdminNegativeTest-1552184501 None] Acquiring lock "cinder-quobyte-1ca69bf4-71ee-4ac6-9c18-b74cbc00eecb" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:06:03 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2c99f953-61b4-423b-9dcc-c2e6ad812b12 tempest-VolumesAdminNegativeTest-1552184501 None] Lock "cinder-quobyte-1ca69bf4-71ee-4ac6-9c18-b74cbc00eecb" acquired by "delete_volume" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:06:03 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35400b1-f347-479b-9cd4-97b2b8508db7]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:06:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2c99f953-61b4-423b-9dcc-c2e6ad812b12 tempest-VolumesAdminNegativeTest-1552184501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1ca69bf4-71ee-4ac6-9c18-b74cbc00eecb {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:03 devstack sudo[88843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f48073d8-83bb-4ea8-ad5c-be4327644dd9 Jul 08 01:06:03 devstack sudo[88843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:03 devstack sudo[88844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1ca69bf4-71ee-4ac6-9c18-b74cbc00eecb Jul 08 01:06:03 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:04 devstack sudo[88843]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-56ca3a97-cd4e-425b-8d01-28aff465de33 tempest-DeleteServersTestJSON-1857914509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f48073d8-83bb-4ea8-ad5c-be4327644dd9" returned: 0 in 1.545s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-56ca3a97-cd4e-425b-8d01-28aff465de33 tempest-DeleteServersTestJSON-1857914509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f48073d8-83bb-4ea8-ad5c-be4327644dd9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:04 devstack sudo[88853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f48073d8-83bb-4ea8-ad5c-be4327644dd9 Jul 08 01:06:04 devstack sudo[88853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:04 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2c99f953-61b4-423b-9dcc-c2e6ad812b12 tempest-VolumesAdminNegativeTest-1552184501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1ca69bf4-71ee-4ac6-9c18-b74cbc00eecb" returned: 0 in 1.539s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2c99f953-61b4-423b-9dcc-c2e6ad812b12 tempest-VolumesAdminNegativeTest-1552184501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1ca69bf4-71ee-4ac6-9c18-b74cbc00eecb {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:04 devstack sudo[88855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1ca69bf4-71ee-4ac6-9c18-b74cbc00eecb Jul 08 01:06:04 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:06 devstack sudo[88853]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-56ca3a97-cd4e-425b-8d01-28aff465de33 tempest-DeleteServersTestJSON-1857914509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f48073d8-83bb-4ea8-ad5c-be4327644dd9" returned: 0 in 1.384s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:06 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-56ca3a97-cd4e-425b-8d01-28aff465de33 tempest-DeleteServersTestJSON-1857914509 None] Lock "cinder-quobyte-f48073d8-83bb-4ea8-ad5c-be4327644dd9" released by "delete_volume" :: held 3.020s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:06:06 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2c99f953-61b4-423b-9dcc-c2e6ad812b12 tempest-VolumesAdminNegativeTest-1552184501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1ca69bf4-71ee-4ac6-9c18-b74cbc00eecb" returned: 0 in 1.516s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:06 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2c99f953-61b4-423b-9dcc-c2e6ad812b12 tempest-VolumesAdminNegativeTest-1552184501 None] Lock "cinder-quobyte-1ca69bf4-71ee-4ac6-9c18-b74cbc00eecb" released by "delete_volume" :: held 3.163s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:06:06 devstack cinder-volume[87022]: WARNING cinder.quota [None req-56ca3a97-cd4e-425b-8d01-28aff465de33 tempest-DeleteServersTestJSON-1857914509 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:06:06 devstack cinder-volume[87022]: WARNING cinder.quota [None req-56ca3a97-cd4e-425b-8d01-28aff465de33 tempest-DeleteServersTestJSON-1857914509 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:06:06 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-56ca3a97-cd4e-425b-8d01-28aff465de33 tempest-DeleteServersTestJSON-1857914509 None] Created reservations ['254945a6-0dda-44b7-a300-f9ee8a13ea6c', '828c5565-22c7-46e1-ad3e-92d74cd9ed7b', '391dbdb7-9e40-4e2b-a66f-cad48033dbb2', '271b1a15-0b24-40ad-a0f7-d72d4913ccf8'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:06:06 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-2c99f953-61b4-423b-9dcc-c2e6ad812b12 tempest-VolumesAdminNegativeTest-1552184501 None] Created reservations ['8857c4bc-54e6-4748-8a22-383339fd2194', '89b85774-0c8e-41fa-98bc-107ede668139', '68255ddd-4a01-4932-ba31-fece22994ad2', '560c17c5-cf6c-42a1-892b-27e16c0d9791'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:06:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-56ca3a97-cd4e-425b-8d01-28aff465de33 tempest-DeleteServersTestJSON-1857914509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:06:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-56ca3a97-cd4e-425b-8d01-28aff465de33 tempest-DeleteServersTestJSON-1857914509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:06:06 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-56ca3a97-cd4e-425b-8d01-28aff465de33 tempest-DeleteServersTestJSON-1857914509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:06:06 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-56ca3a97-cd4e-425b-8d01-28aff465de33 tempest-DeleteServersTestJSON-1857914509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:06:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-56ca3a97-cd4e-425b-8d01-28aff465de33 tempest-DeleteServersTestJSON-1857914509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:06:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-56ca3a97-cd4e-425b-8d01-28aff465de33 tempest-DeleteServersTestJSON-1857914509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:06 devstack sudo[88864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:06:06 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2c99f953-61b4-423b-9dcc-c2e6ad812b12 tempest-VolumesAdminNegativeTest-1552184501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:06:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2c99f953-61b4-423b-9dcc-c2e6ad812b12 tempest-VolumesAdminNegativeTest-1552184501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:06:06 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-2c99f953-61b4-423b-9dcc-c2e6ad812b12 tempest-VolumesAdminNegativeTest-1552184501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:06:06 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-2c99f953-61b4-423b-9dcc-c2e6ad812b12 tempest-VolumesAdminNegativeTest-1552184501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:06:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2c99f953-61b4-423b-9dcc-c2e6ad812b12 tempest-VolumesAdminNegativeTest-1552184501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:06:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2c99f953-61b4-423b-9dcc-c2e6ad812b12 tempest-VolumesAdminNegativeTest-1552184501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:07 devstack sudo[88866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:06:07 devstack sudo[88866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:08 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-56ca3a97-cd4e-425b-8d01-28aff465de33 tempest-DeleteServersTestJSON-1857914509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.414s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:08 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-56ca3a97-cd4e-425b-8d01-28aff465de33 tempest-DeleteServersTestJSON-1857914509 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:06:08 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-56ca3a97-cd4e-425b-8d01-28aff465de33 tempest-DeleteServersTestJSON-1857914509 None] Deleted volume successfully. Jul 08 01:06:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-56ca3a97-cd4e-425b-8d01-28aff465de33 tempest-DeleteServersTestJSON-1857914509 None] Lock "cinder-f48073d8-83bb-4ea8-ad5c-be4327644dd9-delete_volume" released by "delete_volume" :: held 5.502s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:06:08 devstack sudo[88866]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2c99f953-61b4-423b-9dcc-c2e6ad812b12 tempest-VolumesAdminNegativeTest-1552184501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.471s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:08 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-2c99f953-61b4-423b-9dcc-c2e6ad812b12 tempest-VolumesAdminNegativeTest-1552184501 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:06:08 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-2c99f953-61b4-423b-9dcc-c2e6ad812b12 tempest-VolumesAdminNegativeTest-1552184501 None] Deleted volume successfully. Jul 08 01:06:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2c99f953-61b4-423b-9dcc-c2e6ad812b12 tempest-VolumesAdminNegativeTest-1552184501 None] Lock "cinder-1ca69bf4-71ee-4ac6-9c18-b74cbc00eecb-delete_volume" released by "delete_volume" :: held 5.591s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:06:18 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=13,cinder:UPDATE=18,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:06:18 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:UPDATE=21,cinder:SELECT=14,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:06:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-37008914-ec02-4f02-a727-54ab87cf0990 req-5ceef990-a8ef-4d06-a671-29716e4820ee tempest-TaggedAttachmentsTest-1981396856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:06:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-37008914-ec02-4f02-a727-54ab87cf0990 req-5ceef990-a8ef-4d06-a671-29716e4820ee tempest-TaggedAttachmentsTest-1981396856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:06:42 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bb3a0e-bd11-48d2-b4db-4f44eb8b02cb]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:06:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-37008914-ec02-4f02-a727-54ab87cf0990 req-5ceef990-a8ef-4d06-a671-29716e4820ee tempest-TaggedAttachmentsTest-1981396856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f85e5bdb-b06d-46a0-a14f-075d1197e714 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:42 devstack sudo[89102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f85e5bdb-b06d-46a0-a14f-075d1197e714 Jul 08 01:06:42 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:43 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-37008914-ec02-4f02-a727-54ab87cf0990 req-5ceef990-a8ef-4d06-a671-29716e4820ee tempest-TaggedAttachmentsTest-1981396856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f85e5bdb-b06d-46a0-a14f-075d1197e714" returned: 0 in 1.090s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-37008914-ec02-4f02-a727-54ab87cf0990 req-5ceef990-a8ef-4d06-a671-29716e4820ee tempest-TaggedAttachmentsTest-1981396856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.116s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:06:43 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-37008914-ec02-4f02-a727-54ab87cf0990 req-5ceef990-a8ef-4d06-a671-29716e4820ee tempest-TaggedAttachmentsTest-1981396856 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d', 'name': 'volume-f85e5bdb-b06d-46a0-a14f-075d1197e714', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '743a180e-1bb6-4b18-aabe-9c303bd4960f', 'enforce_multipath': True} {{(pid=87022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:06:43 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-37008914-ec02-4f02-a727-54ab87cf0990 req-5ceef990-a8ef-4d06-a671-29716e4820ee tempest-TaggedAttachmentsTest-1981396856 None] attachment_update completed successfully. Jul 08 01:06:45 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:06:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:06:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:06:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:06:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:06:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:06:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:45 devstack sudo[89492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:06:45 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:46 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.557s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:46 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:06:46 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:06:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread count: 8 {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:06:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread info: [<_MainThread(MainThread, started 134382216167552)>, , , , , , , ] {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:06:52 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-668ec945-a261-45e7-97b6-229edbffc432 req-6e6d7c9a-07f4-41fe-9218-696c5c9f4230 tempest-TaggedAttachmentsTest-1981396856 None] Terminate volume connection completed successfully. Jul 08 01:06:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-668ec945-a261-45e7-97b6-229edbffc432 req-6e6d7c9a-07f4-41fe-9218-696c5c9f4230 tempest-TaggedAttachmentsTest-1981396856 None] Deleting attachment 743a180e-1bb6-4b18-aabe-9c303bd4960f. {{(pid=87022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:07:02 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:07:02 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:07:09 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:07:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Flow 'volume_create_manager' (0c3accb7-cf67-4e06-a7bf-23cc88343c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:07:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b944dc98-2ca3-4db3-a5f5-aa3a6fd45d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b944dc98-2ca3-4db3-a5f5-aa3a6fd45d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-785912987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8428352f-b659-4c88-95eb-07e46adff18f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d7ec6fcc1484a60b534dd2111677432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:07:10Z,use_quota=True,user_id='057f450bad574a60b58076dc5873c169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29bcabee-b9c4-4f5d-ae4a-917c0e35930d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29bcabee-b9c4-4f5d-ae4a-917c0e35930d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db21cfb7-5266-4f49-9263-5bb90b4f167d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db21cfb7-5266-4f49-9263-5bb90b4f167d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8428352f-b659-4c88-95eb-07e46adff18f', 'volume_name': 'volume-8428352f-b659-4c88-95eb-07e46adff18f', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4ff1dc2-d0f3-426c-9ab0-cb8cc13b75d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:10 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4ff1dc2-d0f3-426c-9ab0-cb8cc13b75d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:10 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d169f9-5878-47b6-97bd-d9805b778764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:10 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Volume 8428352f-b659-4c88-95eb-07e46adff18f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8428352f-b659-4c88-95eb-07e46adff18f', 'volume_size': 1} Jul 08 01:07:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:07:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:07:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-785912987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8428352f-b659-4c88-95eb-07e46adff18f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d7ec6fcc1484a60b534dd2111677432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:07:10Z,use_quota=True,user_id='057f450bad574a60b58076dc5873c169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:07:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Creating volume 8428352f-b659-4c88-95eb-07e46adff18f {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:07:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:07:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:07:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:07:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:07:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:07:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:07:10 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:07:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8428352f-b659-4c88-95eb-07e46adff18f 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:10 devstack sudo[89779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8428352f-b659-4c88-95eb-07e46adff18f 1073741824 Jul 08 01:07:10 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:11 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8428352f-b659-4c88-95eb-07e46adff18f 1073741824" returned: 0 in 1.204s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8428352f-b659-4c88-95eb-07e46adff18f {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:11 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8428352f-b659-4c88-95eb-07e46adff18f Jul 08 01:07:11 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:12 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8428352f-b659-4c88-95eb-07e46adff18f" returned: 0 in 0.943s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:12 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] <== create_volume: return (2233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:07:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.240s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:07:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d169f9-5878-47b6-97bd-d9805b778764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8428352f-b659-4c88-95eb-07e46adff18f', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53bdd7b2-42bc-44c5-9726-7aaac9b93737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:12 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Volume volume-8428352f-b659-4c88-95eb-07e46adff18f (8428352f-b659-4c88-95eb-07e46adff18f): created successfully Jul 08 01:07:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53bdd7b2-42bc-44c5-9726-7aaac9b93737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Flow 'volume_create_manager' (0c3accb7-cf67-4e06-a7bf-23cc88343c80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:07:12 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-f5a566e5-8aaf-4e59-91a5-0a56222c9e14 tempest-ServerActionsTestOtherA-1318696261 None] Created volume successfully. Jul 08 01:07:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7f8d5ec6-3924-4149-b936-3f5baf6a073b tempest-TaggedAttachmentsTest-1981396856 None] Acquiring lock "cinder-f85e5bdb-b06d-46a0-a14f-075d1197e714-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:07:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7f8d5ec6-3924-4149-b936-3f5baf6a073b tempest-TaggedAttachmentsTest-1981396856 None] Lock "cinder-f85e5bdb-b06d-46a0-a14f-075d1197e714-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:07:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7f8d5ec6-3924-4149-b936-3f5baf6a073b tempest-TaggedAttachmentsTest-1981396856 None] Acquiring lock "cinder-quobyte-f85e5bdb-b06d-46a0-a14f-075d1197e714" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:07:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7f8d5ec6-3924-4149-b936-3f5baf6a073b tempest-TaggedAttachmentsTest-1981396856 None] Lock "cinder-quobyte-f85e5bdb-b06d-46a0-a14f-075d1197e714" acquired by "delete_volume" :: waited 0.023s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:07:16 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[57acb4ea-67cb-43e8-a48c-0b37617bd126]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:07:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7f8d5ec6-3924-4149-b936-3f5baf6a073b tempest-TaggedAttachmentsTest-1981396856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f85e5bdb-b06d-46a0-a14f-075d1197e714 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:16 devstack sudo[89844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f85e5bdb-b06d-46a0-a14f-075d1197e714 Jul 08 01:07:16 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:17 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7f8d5ec6-3924-4149-b936-3f5baf6a073b tempest-TaggedAttachmentsTest-1981396856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f85e5bdb-b06d-46a0-a14f-075d1197e714" returned: 0 in 1.075s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7f8d5ec6-3924-4149-b936-3f5baf6a073b tempest-TaggedAttachmentsTest-1981396856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f85e5bdb-b06d-46a0-a14f-075d1197e714 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:17 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f85e5bdb-b06d-46a0-a14f-075d1197e714 Jul 08 01:07:17 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:18 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7f8d5ec6-3924-4149-b936-3f5baf6a073b tempest-TaggedAttachmentsTest-1981396856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f85e5bdb-b06d-46a0-a14f-075d1197e714" returned: 0 in 0.775s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7f8d5ec6-3924-4149-b936-3f5baf6a073b tempest-TaggedAttachmentsTest-1981396856 None] Lock "cinder-quobyte-f85e5bdb-b06d-46a0-a14f-075d1197e714" released by "delete_volume" :: held 1.929s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:07:18 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-7f8d5ec6-3924-4149-b936-3f5baf6a073b tempest-TaggedAttachmentsTest-1981396856 None] Created reservations ['9eff8336-e6ae-431e-8cc3-589cfb6b7a93', 'b5573e86-3afe-4ad8-92be-b56b87816a06', 'e188fd3c-25e2-47e0-bdec-41c58f722f58', '1386eb6a-41ef-4e96-a4d3-7a26efd7d277'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:07:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7f8d5ec6-3924-4149-b936-3f5baf6a073b tempest-TaggedAttachmentsTest-1981396856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:07:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7f8d5ec6-3924-4149-b936-3f5baf6a073b tempest-TaggedAttachmentsTest-1981396856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:07:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7f8d5ec6-3924-4149-b936-3f5baf6a073b tempest-TaggedAttachmentsTest-1981396856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:07:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7f8d5ec6-3924-4149-b936-3f5baf6a073b tempest-TaggedAttachmentsTest-1981396856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:07:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7f8d5ec6-3924-4149-b936-3f5baf6a073b tempest-TaggedAttachmentsTest-1981396856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:07:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7f8d5ec6-3924-4149-b936-3f5baf6a073b tempest-TaggedAttachmentsTest-1981396856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:18 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:07:18 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:19 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7f8d5ec6-3924-4149-b936-3f5baf6a073b tempest-TaggedAttachmentsTest-1981396856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.905s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:19 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-7f8d5ec6-3924-4149-b936-3f5baf6a073b tempest-TaggedAttachmentsTest-1981396856 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:07:19 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-7f8d5ec6-3924-4149-b936-3f5baf6a073b tempest-TaggedAttachmentsTest-1981396856 None] Deleted volume successfully. Jul 08 01:07:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7f8d5ec6-3924-4149-b936-3f5baf6a073b tempest-TaggedAttachmentsTest-1981396856 None] Lock "cinder-f85e5bdb-b06d-46a0-a14f-075d1197e714-delete_volume" released by "delete_volume" :: held 3.372s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:07:23 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:07:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Flow 'volume_create_manager' (4f92b4cb-ebca-46fe-8682-62fe9452d0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:07:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca5d7ad-b4f0-4606-9dbe-0b5f3cea087d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca5d7ad-b4f0-4606-9dbe-0b5f3cea087d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1760810299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f48f26d4-4d8b-48a4-b4a2-8772d5f0db92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c33b905c85f4dc98336f147fe669cd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:07:23Z,use_quota=True,user_id='2a3b2448bf20410cb70ad97de7804a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc72b7d4-a872-4247-b72b-d882c8fb9605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc72b7d4-a872-4247-b72b-d882c8fb9605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ab4779-424d-4216-ac2d-40ff3713aea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ab4779-424d-4216-ac2d-40ff3713aea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f48f26d4-4d8b-48a4-b4a2-8772d5f0db92', 'volume_name': 'volume-f48f26d4-4d8b-48a4-b4a2-8772d5f0db92', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d90468b-e7f7-4188-b9a0-82ccc8322932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d90468b-e7f7-4188-b9a0-82ccc8322932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae7e644f-adf8-4a20-84c4-bbeed3f19f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:23 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Volume f48f26d4-4d8b-48a4-b4a2-8772d5f0db92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f48f26d4-4d8b-48a4-b4a2-8772d5f0db92', 'volume_size': 1} Jul 08 01:07:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:07:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:07:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1760810299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f48f26d4-4d8b-48a4-b4a2-8772d5f0db92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c33b905c85f4dc98336f147fe669cd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:07:23Z,use_quota=True,user_id='2a3b2448bf20410cb70ad97de7804a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:07:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Creating volume f48f26d4-4d8b-48a4-b4a2-8772d5f0db92 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:07:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:07:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:07:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:07:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:07:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:07:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:07:23 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:07:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f48f26d4-4d8b-48a4-b4a2-8772d5f0db92 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:23 devstack sudo[89932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f48f26d4-4d8b-48a4-b4a2-8772d5f0db92 1073741824 Jul 08 01:07:23 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:24 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f48f26d4-4d8b-48a4-b4a2-8772d5f0db92 1073741824" returned: 0 in 1.311s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f48f26d4-4d8b-48a4-b4a2-8772d5f0db92 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:24 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f48f26d4-4d8b-48a4-b4a2-8772d5f0db92 Jul 08 01:07:24 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:25 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f48f26d4-4d8b-48a4-b4a2-8772d5f0db92" returned: 0 in 1.035s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] <== create_volume: return (2422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:07:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.429s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:07:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae7e644f-adf8-4a20-84c4-bbeed3f19f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f48f26d4-4d8b-48a4-b4a2-8772d5f0db92', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2916b471-d77b-4932-a2ae-2edcac66e91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:25 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Volume volume-f48f26d4-4d8b-48a4-b4a2-8772d5f0db92 (f48f26d4-4d8b-48a4-b4a2-8772d5f0db92): created successfully Jul 08 01:07:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2916b471-d77b-4932-a2ae-2edcac66e91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Flow 'volume_create_manager' (4f92b4cb-ebca-46fe-8682-62fe9452d0ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:07:25 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-c812b177-8c97-47a0-9d75-c3cf17d0d981 tempest-AttachVolumeShelveTestJSON-106540728 None] Created volume successfully. Jul 08 01:07:35 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=11,cinder:INSERT=3,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:07:35 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:UPDATE=16,cinder:SELECT=7,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:07:45 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:07:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:07:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:07:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:07:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:07:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:07:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:45 devstack sudo[90126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:07:45 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:46 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.986s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:46 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:07:48 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-483d808a-32d0-4662-b062-cdd59de68da7 req-6978bed3-7fef-45e3-8e88-4d7569a5388d tempest-AttachVolumeShelveTestJSON-106540728 None] No connector for attachment a3589c7f-3cf1-4f77-934d-039dd7c91b59; skipping storage backend terminate_connection call. {{(pid=87022) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 08 01:07:48 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-483d808a-32d0-4662-b062-cdd59de68da7 req-6978bed3-7fef-45e3-8e88-4d7569a5388d tempest-AttachVolumeShelveTestJSON-106540728 None] Deleting attachment a3589c7f-3cf1-4f77-934d-039dd7c91b59. {{(pid=87022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:07:52 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:07:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Flow 'volume_create_manager' (701f2b5b-8945-4057-9db1-95ed768ecd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:07:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21bddca2-49cb-457b-9e82-9f79cc375006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21bddca2-49cb-457b-9e82-9f79cc375006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-882334035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac11ed05-ae8a-4bd7-bd52-3a284772487a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6c18fb426d4eb9a4e3685222707886',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:07:53Z,use_quota=True,user_id='f7a8afec487249ff804769e916d32cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a28b18c-0f00-4db8-a45a-d90984919879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a28b18c-0f00-4db8-a45a-d90984919879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7624648d-7d90-4406-bb76-a21b017ff3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7624648d-7d90-4406-bb76-a21b017ff3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac11ed05-ae8a-4bd7-bd52-3a284772487a', 'volume_name': 'volume-ac11ed05-ae8a-4bd7-bd52-3a284772487a', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4071980-e9d2-4482-9fc5-6b174f38170d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4071980-e9d2-4482-9fc5-6b174f38170d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a9b432b-0bff-4959-922a-e2ed098c5261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:52 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Volume ac11ed05-ae8a-4bd7-bd52-3a284772487a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac11ed05-ae8a-4bd7-bd52-3a284772487a', 'volume_size': 1} Jul 08 01:07:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:07:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:07:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-882334035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac11ed05-ae8a-4bd7-bd52-3a284772487a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6c18fb426d4eb9a4e3685222707886',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:07:53Z,use_quota=True,user_id='f7a8afec487249ff804769e916d32cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:07:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Creating volume ac11ed05-ae8a-4bd7-bd52-3a284772487a {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:07:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:07:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:07:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:07:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:07:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:07:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:07:52 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:07:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ac11ed05-ae8a-4bd7-bd52-3a284772487a 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:53 devstack sudo[90165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ac11ed05-ae8a-4bd7-bd52-3a284772487a 1073741824 Jul 08 01:07:53 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:54 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ac11ed05-ae8a-4bd7-bd52-3a284772487a 1073741824" returned: 0 in 1.050s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ac11ed05-ae8a-4bd7-bd52-3a284772487a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:54 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ac11ed05-ae8a-4bd7-bd52-3a284772487a Jul 08 01:07:54 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:54 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ac11ed05-ae8a-4bd7-bd52-3a284772487a" returned: 0 in 0.919s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:54 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] <== create_volume: return (2031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:07:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.033s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:07:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a9b432b-0bff-4959-922a-e2ed098c5261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac11ed05-ae8a-4bd7-bd52-3a284772487a', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b18f676-7c67-4c30-9c15-fac7f7855bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:55 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Volume volume-ac11ed05-ae8a-4bd7-bd52-3a284772487a (ac11ed05-ae8a-4bd7-bd52-3a284772487a): created successfully Jul 08 01:07:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b18f676-7c67-4c30-9c15-fac7f7855bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Flow 'volume_create_manager' (701f2b5b-8945-4057-9db1-95ed768ecd48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:07:55 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-7c5b32a1-b6af-42fa-b2bb-37aaec0c5c61 tempest-ServersNegativeTestJSON-1297868161 None] Created volume successfully. Jul 08 01:07:57 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:07:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Flow 'volume_create_manager' (bfbdd328-db13-448e-a562-d5e0f0d0516e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:07:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5a9e7e-c6af-4f30-a321-4fe59756aba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5a9e7e-c6af-4f30-a321-4fe59756aba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1374052526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3707c612-4a9d-4d0a-96b8-046d93fb76a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6c18fb426d4eb9a4e3685222707886',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:07:58Z,use_quota=True,user_id='f7a8afec487249ff804769e916d32cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b4d1d3-af08-4e6d-a9f1-7cfed0471e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b4d1d3-af08-4e6d-a9f1-7cfed0471e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b24873-8461-48e1-b85d-442818f6743f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b24873-8461-48e1-b85d-442818f6743f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3707c612-4a9d-4d0a-96b8-046d93fb76a9', 'volume_name': 'volume-3707c612-4a9d-4d0a-96b8-046d93fb76a9', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be40b093-0df4-4c75-812a-fb6c8f2753df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be40b093-0df4-4c75-812a-fb6c8f2753df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df39ef49-8c89-4357-a1c8-3c79b0e83004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:57 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Volume 3707c612-4a9d-4d0a-96b8-046d93fb76a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3707c612-4a9d-4d0a-96b8-046d93fb76a9', 'volume_size': 1} Jul 08 01:07:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:07:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:07:57 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1374052526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3707c612-4a9d-4d0a-96b8-046d93fb76a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6c18fb426d4eb9a4e3685222707886',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:07:58Z,use_quota=True,user_id='f7a8afec487249ff804769e916d32cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:07:57 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Creating volume 3707c612-4a9d-4d0a-96b8-046d93fb76a9 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:07:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:07:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:07:57 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:07:57 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:07:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:07:57 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:07:57 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:07:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3707c612-4a9d-4d0a-96b8-046d93fb76a9 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:57 devstack sudo[90182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3707c612-4a9d-4d0a-96b8-046d93fb76a9 1073741824 Jul 08 01:07:57 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-d23c723b-1c1e-4a88-90f4-50cc8084de79 req-0355a538-8da6-445b-9ada-3bf19b8958bf tempest-ServerActionsTestOtherA-1318696261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:07:58 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3707c612-4a9d-4d0a-96b8-046d93fb76a9 1073741824" returned: 0 in 1.172s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3707c612-4a9d-4d0a-96b8-046d93fb76a9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:59 devstack sudo[90201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3707c612-4a9d-4d0a-96b8-046d93fb76a9 Jul 08 01:07:59 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:00 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3707c612-4a9d-4d0a-96b8-046d93fb76a9" returned: 0 in 1.069s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:00 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] <== create_volume: return (2352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:08:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.356s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-d23c723b-1c1e-4a88-90f4-50cc8084de79 req-0355a538-8da6-445b-9ada-3bf19b8958bf tempest-ServerActionsTestOtherA-1318696261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.498s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df39ef49-8c89-4357-a1c8-3c79b0e83004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3707c612-4a9d-4d0a-96b8-046d93fb76a9', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee6ffb5-aa96-48b1-b317-55884da68bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:00 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfd7d4e-953d-4789-8b59-f6cdedcd5f9b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-d23c723b-1c1e-4a88-90f4-50cc8084de79 req-0355a538-8da6-445b-9ada-3bf19b8958bf tempest-ServerActionsTestOtherA-1318696261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8428352f-b659-4c88-95eb-07e46adff18f {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:00 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Volume volume-3707c612-4a9d-4d0a-96b8-046d93fb76a9 (3707c612-4a9d-4d0a-96b8-046d93fb76a9): created successfully Jul 08 01:08:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee6ffb5-aa96-48b1-b317-55884da68bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Flow 'volume_create_manager' (bfbdd328-db13-448e-a562-d5e0f0d0516e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:08:00 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-da2153cf-2277-4ec9-b22e-0c5df108d0b2 tempest-ServersNegativeTestJSON-1297868161 None] Created volume successfully. Jul 08 01:08:00 devstack sudo[90239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8428352f-b659-4c88-95eb-07e46adff18f Jul 08 01:08:00 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:01 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-893d85c6-578b-4238-8ae2-48673c7fe7ab tempest-ServersNegativeTestJSON-1297868161 None] Acquiring lock "cinder-3707c612-4a9d-4d0a-96b8-046d93fb76a9-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:01 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-d23c723b-1c1e-4a88-90f4-50cc8084de79 req-0355a538-8da6-445b-9ada-3bf19b8958bf tempest-ServerActionsTestOtherA-1318696261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8428352f-b659-4c88-95eb-07e46adff18f" returned: 0 in 0.985s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-d23c723b-1c1e-4a88-90f4-50cc8084de79 req-0355a538-8da6-445b-9ada-3bf19b8958bf tempest-ServerActionsTestOtherA-1318696261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.043s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:01 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-893d85c6-578b-4238-8ae2-48673c7fe7ab tempest-ServersNegativeTestJSON-1297868161 None] Lock "cinder-3707c612-4a9d-4d0a-96b8-046d93fb76a9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-d23c723b-1c1e-4a88-90f4-50cc8084de79 req-0355a538-8da6-445b-9ada-3bf19b8958bf tempest-ServerActionsTestOtherA-1318696261 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d', 'name': 'volume-8428352f-b659-4c88-95eb-07e46adff18f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee47ec44-271c-4a38-88df-63112cb1864c', 'enforce_multipath': True} {{(pid=87022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:08:01 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-893d85c6-578b-4238-8ae2-48673c7fe7ab tempest-ServersNegativeTestJSON-1297868161 None] Acquiring lock "cinder-quobyte-3707c612-4a9d-4d0a-96b8-046d93fb76a9" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:01 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-893d85c6-578b-4238-8ae2-48673c7fe7ab tempest-ServersNegativeTestJSON-1297868161 None] Lock "cinder-quobyte-3707c612-4a9d-4d0a-96b8-046d93fb76a9" acquired by "delete_volume" :: waited 0.076s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:01 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[582b8477-82dc-420e-8596-47b9b0f754b6]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-893d85c6-578b-4238-8ae2-48673c7fe7ab tempest-ServersNegativeTestJSON-1297868161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3707c612-4a9d-4d0a-96b8-046d93fb76a9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:01 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-d23c723b-1c1e-4a88-90f4-50cc8084de79 req-0355a538-8da6-445b-9ada-3bf19b8958bf tempest-ServerActionsTestOtherA-1318696261 None] attachment_update completed successfully. Jul 08 01:08:01 devstack sudo[90248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3707c612-4a9d-4d0a-96b8-046d93fb76a9 Jul 08 01:08:01 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:02 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-893d85c6-578b-4238-8ae2-48673c7fe7ab tempest-ServersNegativeTestJSON-1297868161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3707c612-4a9d-4d0a-96b8-046d93fb76a9" returned: 0 in 1.025s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-893d85c6-578b-4238-8ae2-48673c7fe7ab tempest-ServersNegativeTestJSON-1297868161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3707c612-4a9d-4d0a-96b8-046d93fb76a9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:02 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3707c612-4a9d-4d0a-96b8-046d93fb76a9 Jul 08 01:08:02 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:03 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-893d85c6-578b-4238-8ae2-48673c7fe7ab tempest-ServersNegativeTestJSON-1297868161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3707c612-4a9d-4d0a-96b8-046d93fb76a9" returned: 0 in 0.832s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:03 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-893d85c6-578b-4238-8ae2-48673c7fe7ab tempest-ServersNegativeTestJSON-1297868161 None] Lock "cinder-quobyte-3707c612-4a9d-4d0a-96b8-046d93fb76a9" released by "delete_volume" :: held 1.939s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:03 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-893d85c6-578b-4238-8ae2-48673c7fe7ab tempest-ServersNegativeTestJSON-1297868161 None] Created reservations ['c658b406-c7db-4e75-a5cc-f524f42c0a95', 'cbe6384a-cf6c-4ce7-847b-d96533e3e2cc', 'fd063851-b81a-4fb4-8f05-a86d934dab29', '37204412-710d-46fc-baae-dc651d7ca68b'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:08:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-893d85c6-578b-4238-8ae2-48673c7fe7ab tempest-ServersNegativeTestJSON-1297868161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-893d85c6-578b-4238-8ae2-48673c7fe7ab tempest-ServersNegativeTestJSON-1297868161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:03 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-893d85c6-578b-4238-8ae2-48673c7fe7ab tempest-ServersNegativeTestJSON-1297868161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:03 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-893d85c6-578b-4238-8ae2-48673c7fe7ab tempest-ServersNegativeTestJSON-1297868161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-893d85c6-578b-4238-8ae2-48673c7fe7ab tempest-ServersNegativeTestJSON-1297868161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-893d85c6-578b-4238-8ae2-48673c7fe7ab tempest-ServersNegativeTestJSON-1297868161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:03 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:08:03 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:04 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-893d85c6-578b-4238-8ae2-48673c7fe7ab tempest-ServersNegativeTestJSON-1297868161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.894s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:04 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-893d85c6-578b-4238-8ae2-48673c7fe7ab tempest-ServersNegativeTestJSON-1297868161 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:08:04 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-893d85c6-578b-4238-8ae2-48673c7fe7ab tempest-ServersNegativeTestJSON-1297868161 None] Deleted volume successfully. Jul 08 01:08:04 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-893d85c6-578b-4238-8ae2-48673c7fe7ab tempest-ServersNegativeTestJSON-1297868161 None] Lock "cinder-3707c612-4a9d-4d0a-96b8-046d93fb76a9-delete_volume" released by "delete_volume" :: held 3.417s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:04 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ddefd381-6055-4b44-adcf-05a2f269a401 tempest-ServersNegativeTestJSON-1297868161 None] Acquiring lock "cinder-ac11ed05-ae8a-4bd7-bd52-3a284772487a-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:04 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ddefd381-6055-4b44-adcf-05a2f269a401 tempest-ServersNegativeTestJSON-1297868161 None] Lock "cinder-ac11ed05-ae8a-4bd7-bd52-3a284772487a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:04 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ddefd381-6055-4b44-adcf-05a2f269a401 tempest-ServersNegativeTestJSON-1297868161 None] Acquiring lock "cinder-quobyte-ac11ed05-ae8a-4bd7-bd52-3a284772487a" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:04 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ddefd381-6055-4b44-adcf-05a2f269a401 tempest-ServersNegativeTestJSON-1297868161 None] Lock "cinder-quobyte-ac11ed05-ae8a-4bd7-bd52-3a284772487a" acquired by "delete_volume" :: waited 0.022s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:04 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[13757631-63e4-45ec-8a17-c63d048b00d3]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ddefd381-6055-4b44-adcf-05a2f269a401 tempest-ServersNegativeTestJSON-1297868161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ac11ed05-ae8a-4bd7-bd52-3a284772487a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:04 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ac11ed05-ae8a-4bd7-bd52-3a284772487a Jul 08 01:08:04 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:05 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ddefd381-6055-4b44-adcf-05a2f269a401 tempest-ServersNegativeTestJSON-1297868161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ac11ed05-ae8a-4bd7-bd52-3a284772487a" returned: 0 in 1.225s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ddefd381-6055-4b44-adcf-05a2f269a401 tempest-ServersNegativeTestJSON-1297868161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ac11ed05-ae8a-4bd7-bd52-3a284772487a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:06 devstack sudo[90702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ac11ed05-ae8a-4bd7-bd52-3a284772487a Jul 08 01:08:06 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:07 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ddefd381-6055-4b44-adcf-05a2f269a401 tempest-ServersNegativeTestJSON-1297868161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ac11ed05-ae8a-4bd7-bd52-3a284772487a" returned: 0 in 1.397s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:07 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ddefd381-6055-4b44-adcf-05a2f269a401 tempest-ServersNegativeTestJSON-1297868161 None] Lock "cinder-quobyte-ac11ed05-ae8a-4bd7-bd52-3a284772487a" released by "delete_volume" :: held 2.715s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:07 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-ddefd381-6055-4b44-adcf-05a2f269a401 tempest-ServersNegativeTestJSON-1297868161 None] Created reservations ['682f0a91-03ef-426b-bd5d-88af02448a22', '351081b1-6f84-4afa-a129-4f2e034779d6', 'ca502291-030b-4587-91e4-336cb709b42b', '86bf03c6-4dd5-4295-84f7-76ef55a65c70'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:08:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ddefd381-6055-4b44-adcf-05a2f269a401 tempest-ServersNegativeTestJSON-1297868161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ddefd381-6055-4b44-adcf-05a2f269a401 tempest-ServersNegativeTestJSON-1297868161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:07 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ddefd381-6055-4b44-adcf-05a2f269a401 tempest-ServersNegativeTestJSON-1297868161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:07 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ddefd381-6055-4b44-adcf-05a2f269a401 tempest-ServersNegativeTestJSON-1297868161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ddefd381-6055-4b44-adcf-05a2f269a401 tempest-ServersNegativeTestJSON-1297868161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ddefd381-6055-4b44-adcf-05a2f269a401 tempest-ServersNegativeTestJSON-1297868161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:07 devstack sudo[90744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:08:07 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:08 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ddefd381-6055-4b44-adcf-05a2f269a401 tempest-ServersNegativeTestJSON-1297868161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.931s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:08 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-ddefd381-6055-4b44-adcf-05a2f269a401 tempest-ServersNegativeTestJSON-1297868161 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:08:08 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-ddefd381-6055-4b44-adcf-05a2f269a401 tempest-ServersNegativeTestJSON-1297868161 None] Deleted volume successfully. Jul 08 01:08:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ddefd381-6055-4b44-adcf-05a2f269a401 tempest-ServersNegativeTestJSON-1297868161 None] Lock "cinder-ac11ed05-ae8a-4bd7-bd52-3a284772487a-delete_volume" released by "delete_volume" :: held 4.046s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:10 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-f008a4a9-a3ae-4b2d-b445-7981c7d94469 req-9eb59e47-8a2b-43c9-8d8e-add77a657340 tempest-ServerActionsTestOtherA-1318696261 None] Terminate volume connection completed successfully. Jul 08 01:08:10 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-f008a4a9-a3ae-4b2d-b445-7981c7d94469 req-9eb59e47-8a2b-43c9-8d8e-add77a657340 tempest-ServerActionsTestOtherA-1318696261 None] Deleting attachment ee47ec44-271c-4a38-88df-63112cb1864c. {{(pid=87022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:08:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-f008a4a9-a3ae-4b2d-b445-7981c7d94469 req-41a2f92d-bb06-4624-b00b-4efc163125e5 tempest-ServerActionsTestOtherA-1318696261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-f008a4a9-a3ae-4b2d-b445-7981c7d94469 req-41a2f92d-bb06-4624-b00b-4efc163125e5 tempest-ServerActionsTestOtherA-1318696261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:13 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c11dcd-badd-4954-aaf4-eb7d0e1a0ea4]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-f008a4a9-a3ae-4b2d-b445-7981c7d94469 req-41a2f92d-bb06-4624-b00b-4efc163125e5 tempest-ServerActionsTestOtherA-1318696261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8428352f-b659-4c88-95eb-07e46adff18f {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:14 devstack sudo[90942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8428352f-b659-4c88-95eb-07e46adff18f Jul 08 01:08:14 devstack sudo[90942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:15 devstack sudo[90942]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-f008a4a9-a3ae-4b2d-b445-7981c7d94469 req-41a2f92d-bb06-4624-b00b-4efc163125e5 tempest-ServerActionsTestOtherA-1318696261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8428352f-b659-4c88-95eb-07e46adff18f" returned: 0 in 1.634s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-f008a4a9-a3ae-4b2d-b445-7981c7d94469 req-41a2f92d-bb06-4624-b00b-4efc163125e5 tempest-ServerActionsTestOtherA-1318696261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.688s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-f008a4a9-a3ae-4b2d-b445-7981c7d94469 req-41a2f92d-bb06-4624-b00b-4efc163125e5 tempest-ServerActionsTestOtherA-1318696261 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d', 'name': 'volume-8428352f-b659-4c88-95eb-07e46adff18f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '91e53f13-f805-4269-9400-d7c4f371c5e4', 'enforce_multipath': True} {{(pid=87022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:08:15 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-f008a4a9-a3ae-4b2d-b445-7981c7d94469 req-41a2f92d-bb06-4624-b00b-4efc163125e5 tempest-ServerActionsTestOtherA-1318696261 None] attachment_update completed successfully. Jul 08 01:08:25 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=29,cinder:UPDATE=22,cinder:INSERT=5,cinder:DELETE=3 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:08:25 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=26,cinder:UPDATE=29,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:08:41 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:08:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Flow 'volume_create_manager' (7df3aaa6-a851-4f90-b0f9-66ddf2f6b3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:08:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (460cc2cb-918e-49a5-afb1-8844f162c266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (460cc2cb-918e-49a5-afb1-8844f162c266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1176253963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d8800f9-49f1-49f5-86c2-fb96f97db74f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='157306108d124cf49329a4cc793bccee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:08:42Z,use_quota=True,user_id='c3db039932bf477285561c8cb7e18fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ed665f-cb88-455d-8b6e-dfc326e56636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ed665f-cb88-455d-8b6e-dfc326e56636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ede6027-c80c-4bae-8100-797156a1dc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ede6027-c80c-4bae-8100-797156a1dc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d8800f9-49f1-49f5-86c2-fb96f97db74f', 'volume_name': 'volume-4d8800f9-49f1-49f5-86c2-fb96f97db74f', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25fac6ea-cfb2-4f5d-9771-e0022ebbb383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25fac6ea-cfb2-4f5d-9771-e0022ebbb383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06041eed-3abc-465c-a1ae-57ea1169a82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:42 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Volume 4d8800f9-49f1-49f5-86c2-fb96f97db74f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d8800f9-49f1-49f5-86c2-fb96f97db74f', 'volume_size': 1} Jul 08 01:08:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:42 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1176253963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d8800f9-49f1-49f5-86c2-fb96f97db74f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='157306108d124cf49329a4cc793bccee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:08:42Z,use_quota=True,user_id='c3db039932bf477285561c8cb7e18fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:08:42 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Creating volume 4d8800f9-49f1-49f5-86c2-fb96f97db74f {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:08:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:42 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:42 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:42 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:08:42 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:08:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4d8800f9-49f1-49f5-86c2-fb96f97db74f 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:42 devstack sudo[91552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4d8800f9-49f1-49f5-86c2-fb96f97db74f 1073741824 Jul 08 01:08:42 devstack sudo[91552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:43 devstack sudo[91552]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4d8800f9-49f1-49f5-86c2-fb96f97db74f 1073741824" returned: 0 in 1.416s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4d8800f9-49f1-49f5-86c2-fb96f97db74f {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:43 devstack sudo[91558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4d8800f9-49f1-49f5-86c2-fb96f97db74f Jul 08 01:08:43 devstack sudo[91558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:44 devstack sudo[91558]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4d8800f9-49f1-49f5-86c2-fb96f97db74f" returned: 0 in 0.846s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] <== create_volume: return (2331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:08:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.335s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06041eed-3abc-465c-a1ae-57ea1169a82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d8800f9-49f1-49f5-86c2-fb96f97db74f', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437e9681-c726-4811-91c1-fe138301a7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:44 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Volume volume-4d8800f9-49f1-49f5-86c2-fb96f97db74f (4d8800f9-49f1-49f5-86c2-fb96f97db74f): created successfully Jul 08 01:08:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437e9681-c726-4811-91c1-fe138301a7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Flow 'volume_create_manager' (7df3aaa6-a851-4f90-b0f9-66ddf2f6b3c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:08:44 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-c7749517-8fcf-4411-a4b0-fd712a85e6be tempest-AttachVolumeNegativeTest-54008946 None] Created volume successfully. Jul 08 01:08:45 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:08:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:45 devstack sudo[91568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:08:45 devstack sudo[91568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:46 devstack sudo[91568]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.832s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:46 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:08:46 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:08:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread count: 8 {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:08:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread info: [<_MainThread(MainThread, started 134382216167552)>, , , , , , , ] {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:08:47 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ac0790e3-2f58-4ff7-b072-801a908d0543 tempest-AttachVolumeShelveTestJSON-106540728 None] Acquiring lock "cinder-f48f26d4-4d8b-48a4-b4a2-8772d5f0db92-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:47 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ac0790e3-2f58-4ff7-b072-801a908d0543 tempest-AttachVolumeShelveTestJSON-106540728 None] Lock "cinder-f48f26d4-4d8b-48a4-b4a2-8772d5f0db92-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:47 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ac0790e3-2f58-4ff7-b072-801a908d0543 tempest-AttachVolumeShelveTestJSON-106540728 None] Acquiring lock "cinder-quobyte-f48f26d4-4d8b-48a4-b4a2-8772d5f0db92" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:47 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ac0790e3-2f58-4ff7-b072-801a908d0543 tempest-AttachVolumeShelveTestJSON-106540728 None] Lock "cinder-quobyte-f48f26d4-4d8b-48a4-b4a2-8772d5f0db92" acquired by "delete_volume" :: waited 0.022s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:47 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[502053c1-6267-465e-8e2a-76e221940cb6]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ac0790e3-2f58-4ff7-b072-801a908d0543 tempest-AttachVolumeShelveTestJSON-106540728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f48f26d4-4d8b-48a4-b4a2-8772d5f0db92 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:47 devstack sudo[91575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f48f26d4-4d8b-48a4-b4a2-8772d5f0db92 Jul 08 01:08:47 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-b0e1ea95-38e9-4f49-ad9d-13409c8432b7 req-1b09e828-a084-4906-95ea-ffbda841b3cc tempest-AttachVolumeNegativeTest-54008946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-b0e1ea95-38e9-4f49-ad9d-13409c8432b7 req-1b09e828-a084-4906-95ea-ffbda841b3cc tempest-AttachVolumeNegativeTest-54008946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:48 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a9bded-e848-42e8-aa00-c375ce482e16]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-b0e1ea95-38e9-4f49-ad9d-13409c8432b7 req-1b09e828-a084-4906-95ea-ffbda841b3cc tempest-AttachVolumeNegativeTest-54008946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4d8800f9-49f1-49f5-86c2-fb96f97db74f {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:48 devstack sudo[91585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4d8800f9-49f1-49f5-86c2-fb96f97db74f Jul 08 01:08:48 devstack sudo[91585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:48 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ac0790e3-2f58-4ff7-b072-801a908d0543 tempest-AttachVolumeShelveTestJSON-106540728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f48f26d4-4d8b-48a4-b4a2-8772d5f0db92" returned: 0 in 1.042s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ac0790e3-2f58-4ff7-b072-801a908d0543 tempest-AttachVolumeShelveTestJSON-106540728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f48f26d4-4d8b-48a4-b4a2-8772d5f0db92 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:48 devstack sudo[91590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f48f26d4-4d8b-48a4-b4a2-8772d5f0db92 Jul 08 01:08:48 devstack sudo[91590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:49 devstack sudo[91585]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-b0e1ea95-38e9-4f49-ad9d-13409c8432b7 req-1b09e828-a084-4906-95ea-ffbda841b3cc tempest-AttachVolumeNegativeTest-54008946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4d8800f9-49f1-49f5-86c2-fb96f97db74f" returned: 0 in 0.980s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-b0e1ea95-38e9-4f49-ad9d-13409c8432b7 req-1b09e828-a084-4906-95ea-ffbda841b3cc tempest-AttachVolumeNegativeTest-54008946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-b0e1ea95-38e9-4f49-ad9d-13409c8432b7 req-1b09e828-a084-4906-95ea-ffbda841b3cc tempest-AttachVolumeNegativeTest-54008946 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d', 'name': 'volume-4d8800f9-49f1-49f5-86c2-fb96f97db74f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37df93b5-ac9c-4b69-be9d-3b818866a0a0', 'enforce_multipath': True} {{(pid=87022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:08:49 devstack sudo[91590]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ac0790e3-2f58-4ff7-b072-801a908d0543 tempest-AttachVolumeShelveTestJSON-106540728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f48f26d4-4d8b-48a4-b4a2-8772d5f0db92" returned: 0 in 0.864s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:49 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ac0790e3-2f58-4ff7-b072-801a908d0543 tempest-AttachVolumeShelveTestJSON-106540728 None] Lock "cinder-quobyte-f48f26d4-4d8b-48a4-b4a2-8772d5f0db92" released by "delete_volume" :: held 1.974s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:49 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-b0e1ea95-38e9-4f49-ad9d-13409c8432b7 req-1b09e828-a084-4906-95ea-ffbda841b3cc tempest-AttachVolumeNegativeTest-54008946 None] attachment_update completed successfully. Jul 08 01:08:49 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-ac0790e3-2f58-4ff7-b072-801a908d0543 tempest-AttachVolumeShelveTestJSON-106540728 None] Created reservations ['f45f522b-991d-4fcd-9050-40e90d79abab', '1ef29437-e4fa-4703-a247-45c0b5406f21', '0cb7c02a-888f-4531-9845-bf9e1a4e8124', '18434b7e-fb35-4007-8f9f-9f5083919c34'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:08:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ac0790e3-2f58-4ff7-b072-801a908d0543 tempest-AttachVolumeShelveTestJSON-106540728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ac0790e3-2f58-4ff7-b072-801a908d0543 tempest-AttachVolumeShelveTestJSON-106540728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:49 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ac0790e3-2f58-4ff7-b072-801a908d0543 tempest-AttachVolumeShelveTestJSON-106540728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:49 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ac0790e3-2f58-4ff7-b072-801a908d0543 tempest-AttachVolumeShelveTestJSON-106540728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ac0790e3-2f58-4ff7-b072-801a908d0543 tempest-AttachVolumeShelveTestJSON-106540728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ac0790e3-2f58-4ff7-b072-801a908d0543 tempest-AttachVolumeShelveTestJSON-106540728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:49 devstack sudo[91596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:08:49 devstack sudo[91596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:50 devstack sudo[91596]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ac0790e3-2f58-4ff7-b072-801a908d0543 tempest-AttachVolumeShelveTestJSON-106540728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.049s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:50 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-ac0790e3-2f58-4ff7-b072-801a908d0543 tempest-AttachVolumeShelveTestJSON-106540728 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:08:50 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-ac0790e3-2f58-4ff7-b072-801a908d0543 tempest-AttachVolumeShelveTestJSON-106540728 None] Deleted volume successfully. Jul 08 01:08:51 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ac0790e3-2f58-4ff7-b072-801a908d0543 tempest-AttachVolumeShelveTestJSON-106540728 None] Lock "cinder-f48f26d4-4d8b-48a4-b4a2-8772d5f0db92-delete_volume" released by "delete_volume" :: held 3.355s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:59 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:UPDATE=13,cinder:SELECT=11,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:09:00 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=14,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:09:01 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-4197b24b-8a64-4418-b63a-b01341d683c8 tempest-GroupSnapshotsTest-519473988 None] Group tempest-GroupSnapshotsTest-Group-1333790670: creating Jul 08 01:09:01 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-4197b24b-8a64-4418-b63a-b01341d683c8 tempest-GroupSnapshotsTest-519473988 None] Group tempest-GroupSnapshotsTest-Group-1333790670: created successfully Jul 08 01:09:01 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-4197b24b-8a64-4418-b63a-b01341d683c8 tempest-GroupSnapshotsTest-519473988 None] Create group completed successfully. Jul 08 01:09:03 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:09:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Flow 'volume_create_manager' (f8a2bea5-43eb-4760-b8dc-294f42c9d2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195708fc-ae46-4c73-abd7-28d68abc50cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195708fc-ae46-4c73-abd7-28d68abc50cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-339861778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bfb5e28b-4c0b-4e5e-8d15-119f31c4813c,host='devstack@QuobyteHD#QuobyteHD',id=8bfab1e8-025d-4900-9839-f8964925952e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952061960b6b47b890c81f0caf6827db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:04Z,use_quota=True,user_id='49f97b0edcd94544ae5cb386dcb76b4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f79b5bc-92c6-485d-85d4-818e4c7b1174),volume_type_id=8f79b5bc-92c6-485d-85d4-818e4c7b1174)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10eb17ad-e1f8-4491-a5ec-e2792d677694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10eb17ad-e1f8-4491-a5ec-e2792d677694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (041eec44-0b08-4400-8f89-7aed112364dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (041eec44-0b08-4400-8f89-7aed112364dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bfab1e8-025d-4900-9839-f8964925952e', 'volume_name': 'volume-8bfab1e8-025d-4900-9839-f8964925952e', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12cc3bc7-4e7b-4df7-86ab-63f262d6f3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12cc3bc7-4e7b-4df7-86ab-63f262d6f3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9beeb71c-b6ef-459e-9a6a-3b8115a7e3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:03 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Volume 8bfab1e8-025d-4900-9839-f8964925952e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bfab1e8-025d-4900-9839-f8964925952e', 'volume_size': 1} Jul 08 01:09:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:03 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bfb5e28b-4c0b-4e5e-8d15-119f31c4813c,created_at=2026-07-07T23:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-339861778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bfb5e28b-4c0b-4e5e-8d15-119f31c4813c,host='devstack@QuobyteHD#QuobyteHD',id=8bfab1e8-025d-4900-9839-f8964925952e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952061960b6b47b890c81f0caf6827db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:04Z,use_quota=True,user_id='49f97b0edcd94544ae5cb386dcb76b4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f79b5bc-92c6-485d-85d4-818e4c7b1174),volume_type_id=8f79b5bc-92c6-485d-85d4-818e4c7b1174)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:09:03 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Creating volume 8bfab1e8-025d-4900-9839-f8964925952e {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:09:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:03 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:03 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:03 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:09:03 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:09:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:04 devstack sudo[91755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e 1073741824 Jul 08 01:09:04 devstack sudo[91755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:05 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-a814b46b-9ef0-4fad-976f-d80cc491cb09 req-398fe979-58dd-43ed-b3d0-131918bfd36b tempest-ServerActionsTestOtherA-1318696261 None] Terminate volume connection completed successfully. Jul 08 01:09:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-a814b46b-9ef0-4fad-976f-d80cc491cb09 req-398fe979-58dd-43ed-b3d0-131918bfd36b tempest-ServerActionsTestOtherA-1318696261 None] Deleting attachment 91e53f13-f805-4269-9400-d7c4f371c5e4. {{(pid=87022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:09:05 devstack sudo[91755]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e 1073741824" returned: 0 in 1.440s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:05 devstack sudo[91763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e Jul 08 01:09:05 devstack sudo[91763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:06 devstack sudo[91763]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e" returned: 0 in 1.225s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:06 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] <== create_volume: return (2722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:09:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.727s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9beeb71c-b6ef-459e-9a6a-3b8115a7e3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bfab1e8-025d-4900-9839-f8964925952e', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91606639-1bb1-4c24-be1c-38627f363789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:06 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Volume volume-8bfab1e8-025d-4900-9839-f8964925952e (8bfab1e8-025d-4900-9839-f8964925952e): created successfully Jul 08 01:09:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91606639-1bb1-4c24-be1c-38627f363789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Flow 'volume_create_manager' (f8a2bea5-43eb-4760-b8dc-294f42c9d2bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:06 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-3faf62d5-64d8-45f8-b755-3fa2e64f7ef1 tempest-GroupSnapshotsTest-519473988 None] Created volume successfully. Jul 08 01:09:08 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-99bfe7ab-9e66-47ba-b124-0cd2f592d585 tempest-GroupSnapshotsTest-519473988 None] GroupSnapshot 6caae589-ede7-4c7a-9ecb-bfd3f09be957: creating. Jul 08 01:09:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-99bfe7ab-9e66-47ba-b124-0cd2f592d585 tempest-GroupSnapshotsTest-519473988 None] Group snapshot 6caae589-ede7-4c7a-9ecb-bfd3f09be957: creating. {{(pid=87022) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 01:09:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-99bfe7ab-9e66-47ba-b124-0cd2f592d585 tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-99bfe7ab-9e66-47ba-b124-0cd2f592d585 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:08 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-99bfe7ab-9e66-47ba-b124-0cd2f592d585 tempest-GroupSnapshotsTest-519473988 None] Creating offline snapshot dbf36dcb-9563-45fe-98d5-7e46b7417fdc of volume 8bfab1e8-025d-4900-9839-f8964925952e {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:09:08 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[60be8400-0e1c-4e23-8804-3764a2355e1d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-99bfe7ab-9e66-47ba-b124-0cd2f592d585 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:08 devstack sudo[91790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e Jul 08 01:09:08 devstack sudo[91790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:09 devstack sudo[91790]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-99bfe7ab-9e66-47ba-b124-0cd2f592d585 tempest-GroupSnapshotsTest-519473988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e" returned: 0 in 0.876s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-99bfe7ab-9e66-47ba-b124-0cd2f592d585 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e.dbf36dcb-9563-45fe-98d5-7e46b7417fdc 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:09 devstack sudo[91801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e.dbf36dcb-9563-45fe-98d5-7e46b7417fdc 1G Jul 08 01:09:09 devstack sudo[91801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:10 devstack sudo[91801]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-99bfe7ab-9e66-47ba-b124-0cd2f592d585 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e.dbf36dcb-9563-45fe-98d5-7e46b7417fdc 1G" returned: 0 in 1.444s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-99bfe7ab-9e66-47ba-b124-0cd2f592d585 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bfab1e8-025d-4900-9839-f8964925952e -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e.dbf36dcb-9563-45fe-98d5-7e46b7417fdc {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:10 devstack sudo[91827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bfab1e8-025d-4900-9839-f8964925952e -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e.dbf36dcb-9563-45fe-98d5-7e46b7417fdc Jul 08 01:09:10 devstack sudo[91827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:11 devstack sudo[91827]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-99bfe7ab-9e66-47ba-b124-0cd2f592d585 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bfab1e8-025d-4900-9839-f8964925952e -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e.dbf36dcb-9563-45fe-98d5-7e46b7417fdc" returned: 0 in 1.038s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:11 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-99bfe7ab-9e66-47ba-b124-0cd2f592d585 tempest-GroupSnapshotsTest-519473988 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e.dbf36dcb-9563-45fe-98d5-7e46b7417fdc is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:09:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-99bfe7ab-9e66-47ba-b124-0cd2f592d585 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e.dbf36dcb-9563-45fe-98d5-7e46b7417fdc {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:12 devstack sudo[91836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e.dbf36dcb-9563-45fe-98d5-7e46b7417fdc Jul 08 01:09:12 devstack sudo[91836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:13 devstack sudo[91836]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-99bfe7ab-9e66-47ba-b124-0cd2f592d585 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e.dbf36dcb-9563-45fe-98d5-7e46b7417fdc" returned: 0 in 1.279s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-99bfe7ab-9e66-47ba-b124-0cd2f592d585 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:13 devstack sudo[91857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e.info Jul 08 01:09:13 devstack sudo[91857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:14 devstack sudo[91857]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-99bfe7ab-9e66-47ba-b124-0cd2f592d585 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e.info" returned: 0 in 0.951s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:14 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-99bfe7ab-9e66-47ba-b124-0cd2f592d585 tempest-GroupSnapshotsTest-519473988 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:09:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-99bfe7ab-9e66-47ba-b124-0cd2f592d585 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:14 devstack sudo[91905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e.info Jul 08 01:09:14 devstack sudo[91905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:15 devstack sudo[91905]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-99bfe7ab-9e66-47ba-b124-0cd2f592d585 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e.info" returned: 0 in 0.942s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-99bfe7ab-9e66-47ba-b124-0cd2f592d585 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.680s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:15 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-99bfe7ab-9e66-47ba-b124-0cd2f592d585 tempest-GroupSnapshotsTest-519473988 None] group_snapshot 6caae589-ede7-4c7a-9ecb-bfd3f09be957: created successfully Jul 08 01:09:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:17 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "cinder-quobyte-dbf36dcb-9563-45fe-98d5-7e46b7417fdc-6b347b88-836d-4b66-aaa0-6eca020980cb" by "_create_volume_from_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:17 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-dbf36dcb-9563-45fe-98d5-7e46b7417fdc-6b347b88-836d-4b66-aaa0-6eca020980cb" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Creating volume 6b347b88-836d-4b66-aaa0-6eca020980cb from snapshot dbf36dcb-9563-45fe-98d5-7e46b7417fdc {{(pid=87022) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:09:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:09:17 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "cinder-quobyte-6b347b88-836d-4b66-aaa0-6eca020980cb" by "_copy_volume_from_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:17 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-6b347b88-836d-4b66-aaa0-6eca020980cb" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] snapshot: dbf36dcb-9563-45fe-98d5-7e46b7417fdc, volume: 6b347b88-836d-4b66-aaa0-6eca020980cb, {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:09:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:17 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fde709c-e51e-4939-b2b9-bc968ffeab1e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e.dbf36dcb-9563-45fe-98d5-7e46b7417fdc {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:18 devstack sudo[91928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e.dbf36dcb-9563-45fe-98d5-7e46b7417fdc Jul 08 01:09:18 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:19 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e.dbf36dcb-9563-45fe-98d5-7e46b7417fdc" returned: 0 in 1.215s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bfab1e8-025d-4900-9839-f8964925952e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:09:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] will copy from snapshot at /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:09:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Creating direct copy from snapshot {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:09:19 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6725a9-51a3-4bd0-840f-be4912f420e1]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:19 devstack sudo[91934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e Jul 08 01:09:19 devstack sudo[91934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bb07f9fc-1f30-439f-9c31-7d7a3f8dceba tempest-ServerActionsTestOtherA-1318696261 None] Acquiring lock "cinder-8428352f-b659-4c88-95eb-07e46adff18f-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bb07f9fc-1f30-439f-9c31-7d7a3f8dceba tempest-ServerActionsTestOtherA-1318696261 None] Lock "cinder-8428352f-b659-4c88-95eb-07e46adff18f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bb07f9fc-1f30-439f-9c31-7d7a3f8dceba tempest-ServerActionsTestOtherA-1318696261 None] Acquiring lock "cinder-quobyte-8428352f-b659-4c88-95eb-07e46adff18f" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bb07f9fc-1f30-439f-9c31-7d7a3f8dceba tempest-ServerActionsTestOtherA-1318696261 None] Lock "cinder-quobyte-8428352f-b659-4c88-95eb-07e46adff18f" acquired by "delete_volume" :: waited 0.028s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:19 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae98c47-9935-443e-9c6c-637ced2ae4c8]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bb07f9fc-1f30-439f-9c31-7d7a3f8dceba tempest-ServerActionsTestOtherA-1318696261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8428352f-b659-4c88-95eb-07e46adff18f {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:19 devstack sudo[91938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8428352f-b659-4c88-95eb-07e46adff18f Jul 08 01:09:19 devstack sudo[91938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:20 devstack sudo[91934]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e" returned: 0 in 1.039s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:20 devstack cinder-volume[87022]: DEBUG cinder.utils [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Path /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6b347b88-836d-4b66-aaa0-6eca020980cb not found in is_blk_device check {{(pid=87022) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:09:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6b347b88-836d-4b66-aaa0-6eca020980cb {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:20 devstack sudo[91943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6b347b88-836d-4b66-aaa0-6eca020980cb Jul 08 01:09:20 devstack sudo[91943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:20 devstack sudo[91938]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bb07f9fc-1f30-439f-9c31-7d7a3f8dceba tempest-ServerActionsTestOtherA-1318696261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8428352f-b659-4c88-95eb-07e46adff18f" returned: 0 in 1.117s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bb07f9fc-1f30-439f-9c31-7d7a3f8dceba tempest-ServerActionsTestOtherA-1318696261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8428352f-b659-4c88-95eb-07e46adff18f {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:20 devstack sudo[91950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8428352f-b659-4c88-95eb-07e46adff18f Jul 08 01:09:20 devstack sudo[91950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:22 devstack sudo[91950]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bb07f9fc-1f30-439f-9c31-7d7a3f8dceba tempest-ServerActionsTestOtherA-1318696261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8428352f-b659-4c88-95eb-07e46adff18f" returned: 0 in 1.318s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bb07f9fc-1f30-439f-9c31-7d7a3f8dceba tempest-ServerActionsTestOtherA-1318696261 None] Lock "cinder-quobyte-8428352f-b659-4c88-95eb-07e46adff18f" released by "delete_volume" :: held 2.515s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:09:22 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-bb07f9fc-1f30-439f-9c31-7d7a3f8dceba tempest-ServerActionsTestOtherA-1318696261 None] Created reservations ['50a670e5-08db-4aac-b4fa-5937c8097d04', '598bca42-43c1-4a07-8469-e9a06441069a', 'e8a7be8d-6e65-4528-aaa5-6045d9ce4b48', 'c88832a7-9005-40de-92e3-d3c2dc5f4504'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:09:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bb07f9fc-1f30-439f-9c31-7d7a3f8dceba tempest-ServerActionsTestOtherA-1318696261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bb07f9fc-1f30-439f-9c31-7d7a3f8dceba tempest-ServerActionsTestOtherA-1318696261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:22 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bb07f9fc-1f30-439f-9c31-7d7a3f8dceba tempest-ServerActionsTestOtherA-1318696261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:22 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bb07f9fc-1f30-439f-9c31-7d7a3f8dceba tempest-ServerActionsTestOtherA-1318696261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bb07f9fc-1f30-439f-9c31-7d7a3f8dceba tempest-ServerActionsTestOtherA-1318696261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bb07f9fc-1f30-439f-9c31-7d7a3f8dceba tempest-ServerActionsTestOtherA-1318696261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:22 devstack sudo[91978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:09:22 devstack sudo[91978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:24 devstack sudo[91978]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bb07f9fc-1f30-439f-9c31-7d7a3f8dceba tempest-ServerActionsTestOtherA-1318696261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 2.335s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:24 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-bb07f9fc-1f30-439f-9c31-7d7a3f8dceba tempest-ServerActionsTestOtherA-1318696261 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:09:24 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-bb07f9fc-1f30-439f-9c31-7d7a3f8dceba tempest-ServerActionsTestOtherA-1318696261 None] Deleted volume successfully. Jul 08 01:09:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bb07f9fc-1f30-439f-9c31-7d7a3f8dceba tempest-ServerActionsTestOtherA-1318696261 None] Lock "cinder-8428352f-b659-4c88-95eb-07e46adff18f-delete_volume" released by "delete_volume" :: held 5.584s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:09:29 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:09:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Flow 'volume_create_manager' (f576779f-4b95-4189-8fc5-cb6f3a19c0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (940520a4-e7b0-44e2-aa5c-e88d881d0da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (940520a4-e7b0-44e2-aa5c-e88d881d0da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1307407442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f21dd4-9a7b-46c3-92c1-67241c03b050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c92b41a8c8d44b81a54ec8b95273ca6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:29Z,use_quota=True,user_id='f9c3dd452069487a99049969dbb9ea6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef7d1bc4-ffae-480f-a9c9-0ab7a787fc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:29 devstack sudo[91943]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef7d1bc4-ffae-480f-a9c9-0ab7a787fc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf1bada-bac9-411e-9cec-7c1ad6133bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf1bada-bac9-411e-9cec-7c1ad6133bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5f21dd4-9a7b-46c3-92c1-67241c03b050', 'volume_name': 'volume-b5f21dd4-9a7b-46c3-92c1-67241c03b050', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb130b5-9581-4263-a8fa-eb565868dd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb130b5-9581-4263-a8fa-eb565868dd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89977d2e-ba6b-4ec1-9c9b-c5e9c162d81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:29 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Volume b5f21dd4-9a7b-46c3-92c1-67241c03b050: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5f21dd4-9a7b-46c3-92c1-67241c03b050', 'volume_size': 1} Jul 08 01:09:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6b347b88-836d-4b66-aaa0-6eca020980cb" returned: 0 in 9.225s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:29 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b23275-718f-42b3-ac90-e304d8159a6e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:29 devstack sudo[92039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e Jul 08 01:09:29 devstack sudo[92039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:30 devstack sudo[92039]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e" returned: 0 in 1.153s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:30 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Image conversion details: src /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e, size 1024.00 MB, duration 9.23 sec, destination /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6b347b88-836d-4b66-aaa0-6eca020980cb {{(pid=87022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:09:30 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Converted 1024.00 MB image at 110.99 MB/s Jul 08 01:09:30 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6b347b88-836d-4b66-aaa0-6eca020980cb is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:09:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6b347b88-836d-4b66-aaa0-6eca020980cb {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:30 devstack sudo[92045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6b347b88-836d-4b66-aaa0-6eca020980cb Jul 08 01:09:30 devstack sudo[92045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:31 devstack sudo[92045]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6b347b88-836d-4b66-aaa0-6eca020980cb" returned: 0 in 0.757s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-6b347b88-836d-4b66-aaa0-6eca020980cb" released by "_copy_volume_from_snapshot" :: held 13.577s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:09:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-dbf36dcb-9563-45fe-98d5-7e46b7417fdc-6b347b88-836d-4b66-aaa0-6eca020980cb" released by "_create_volume_from_snapshot" :: held 13.643s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:09:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.687s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.963s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1307407442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f21dd4-9a7b-46c3-92c1-67241c03b050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c92b41a8c8d44b81a54ec8b95273ca6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:29Z,use_quota=True,user_id='f9c3dd452069487a99049969dbb9ea6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:09:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Creating volume b5f21dd4-9a7b-46c3-92c1-67241c03b050 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:09:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:09:31 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:09:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b5f21dd4-9a7b-46c3-92c1-67241c03b050 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:31 devstack sudo[92048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b5f21dd4-9a7b-46c3-92c1-67241c03b050 1073741824 Jul 08 01:09:31 devstack sudo[92048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:31 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-b3954a9d-d72b-4398-a3de-4b4e6d520e92 tempest-GroupSnapshotsTest-519473988 None] Create group from source-snapshot-6caae589-ede7-4c7a-9ecb-bfd3f09be957 completed successfully. Jul 08 01:09:32 devstack sudo[92048]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b5f21dd4-9a7b-46c3-92c1-67241c03b050 1073741824" returned: 0 in 0.862s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b5f21dd4-9a7b-46c3-92c1-67241c03b050 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:32 devstack sudo[92054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b5f21dd4-9a7b-46c3-92c1-67241c03b050 Jul 08 01:09:32 devstack sudo[92054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:32 devstack sudo[92054]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b5f21dd4-9a7b-46c3-92c1-67241c03b050" returned: 0 in 0.693s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:32 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:09:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:32 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89977d2e-ba6b-4ec1-9c9b-c5e9c162d81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5f21dd4-9a7b-46c3-92c1-67241c03b050', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:32 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67d8102d-2cf1-4077-b790-572cfefed59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:32 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Volume volume-b5f21dd4-9a7b-46c3-92c1-67241c03b050 (b5f21dd4-9a7b-46c3-92c1-67241c03b050): created successfully Jul 08 01:09:32 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67d8102d-2cf1-4077-b790-572cfefed59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Flow 'volume_create_manager' (f576779f-4b95-4189-8fc5-cb6f3a19c0bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:33 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-72cb1d1d-3261-44b6-b776-05038e44d8dc tempest-AttachVolumeTestJSON-1253782169 None] Created volume successfully. Jul 08 01:09:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-fc6dda62-504c-4294-b2ed-29d2301e18dd tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "cinder-quobyte-6b347b88-836d-4b66-aaa0-6eca020980cb" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-fc6dda62-504c-4294-b2ed-29d2301e18dd tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-6b347b88-836d-4b66-aaa0-6eca020980cb" acquired by "delete_volume" :: waited 0.024s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:33 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51c39f4-cfd3-4cce-912c-4f4dc78a52cb]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fc6dda62-504c-4294-b2ed-29d2301e18dd tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6b347b88-836d-4b66-aaa0-6eca020980cb {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:33 devstack sudo[92057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6b347b88-836d-4b66-aaa0-6eca020980cb Jul 08 01:09:33 devstack sudo[92057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:34 devstack sudo[92057]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fc6dda62-504c-4294-b2ed-29d2301e18dd tempest-GroupSnapshotsTest-519473988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6b347b88-836d-4b66-aaa0-6eca020980cb" returned: 0 in 0.939s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fc6dda62-504c-4294-b2ed-29d2301e18dd tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6b347b88-836d-4b66-aaa0-6eca020980cb {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:34 devstack sudo[92066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6b347b88-836d-4b66-aaa0-6eca020980cb Jul 08 01:09:34 devstack sudo[92066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:34 devstack sudo[92066]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fc6dda62-504c-4294-b2ed-29d2301e18dd tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6b347b88-836d-4b66-aaa0-6eca020980cb" returned: 0 in 0.759s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:34 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-fc6dda62-504c-4294-b2ed-29d2301e18dd tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-6b347b88-836d-4b66-aaa0-6eca020980cb" released by "delete_volume" :: held 1.753s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:09:35 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-fc6dda62-504c-4294-b2ed-29d2301e18dd tempest-GroupSnapshotsTest-519473988 None] Created reservations ['2b09b157-a1d8-4b71-8176-e3515c14e86d'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:09:35 devstack cinder-volume[87022]: WARNING cinder.quota [None req-fc6dda62-504c-4294-b2ed-29d2301e18dd tempest-GroupSnapshotsTest-519473988 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-228886225 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-228886225, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:09:35 devstack cinder-volume[87022]: WARNING cinder.quota [None req-fc6dda62-504c-4294-b2ed-29d2301e18dd tempest-GroupSnapshotsTest-519473988 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-228886225 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-228886225, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:09:35 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-fc6dda62-504c-4294-b2ed-29d2301e18dd tempest-GroupSnapshotsTest-519473988 None] Created reservations ['443de48d-1333-4452-8011-7d680895fbad', 'e68bbc59-fdba-43f0-a653-67f5eeb37c21', 'f10596ca-eb6f-48dd-adda-49bd74dbe66d', '6792095f-4441-42f1-8fc3-dc729c7553b4'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:09:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-fc6dda62-504c-4294-b2ed-29d2301e18dd tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-fc6dda62-504c-4294-b2ed-29d2301e18dd tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:35 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-fc6dda62-504c-4294-b2ed-29d2301e18dd tempest-GroupSnapshotsTest-519473988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:35 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-fc6dda62-504c-4294-b2ed-29d2301e18dd tempest-GroupSnapshotsTest-519473988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-fc6dda62-504c-4294-b2ed-29d2301e18dd tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fc6dda62-504c-4294-b2ed-29d2301e18dd tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:35 devstack sudo[92069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:09:35 devstack sudo[92069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:35 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-2b54486d-a685-4c1a-b397-c46863051112 tempest-GroupSnapshotsTest-519473988 None] group_snapshot 6caae589-ede7-4c7a-9ecb-bfd3f09be957: deleting Jul 08 01:09:35 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-2b54486d-a685-4c1a-b397-c46863051112 tempest-GroupSnapshotsTest-519473988 None] group_snapshot 6caae589-ede7-4c7a-9ecb-bfd3f09be957: deleting {{(pid=87022) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 01:09:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2b54486d-a685-4c1a-b397-c46863051112 tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "cinder-quobyte-8bfab1e8-025d-4900-9839-f8964925952e" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2b54486d-a685-4c1a-b397-c46863051112 tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-8bfab1e8-025d-4900-9839-f8964925952e" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2b54486d-a685-4c1a-b397-c46863051112 tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "cinder-quobyte-dbf36dcb-9563-45fe-98d5-7e46b7417fdc" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2b54486d-a685-4c1a-b397-c46863051112 tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-dbf36dcb-9563-45fe-98d5-7e46b7417fdc" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:35 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-2b54486d-a685-4c1a-b397-c46863051112 tempest-GroupSnapshotsTest-519473988 None] Deleting offline snapshot dbf36dcb-9563-45fe-98d5-7e46b7417fdc of volume 8bfab1e8-025d-4900-9839-f8964925952e {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:09:35 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-2b54486d-a685-4c1a-b397-c46863051112 tempest-GroupSnapshotsTest-519473988 None] snapshot_file for this snap is: volume-8bfab1e8-025d-4900-9839-f8964925952e.dbf36dcb-9563-45fe-98d5-7e46b7417fdc {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:09:35 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[77563ada-e87a-4949-9a82-d15ec0fadf56]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2b54486d-a685-4c1a-b397-c46863051112 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e.dbf36dcb-9563-45fe-98d5-7e46b7417fdc {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:36 devstack sudo[92069]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fc6dda62-504c-4294-b2ed-29d2301e18dd tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.932s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:36 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-fc6dda62-504c-4294-b2ed-29d2301e18dd tempest-GroupSnapshotsTest-519473988 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:09:36 devstack sudo[92072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e.dbf36dcb-9563-45fe-98d5-7e46b7417fdc Jul 08 01:09:36 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-fc6dda62-504c-4294-b2ed-29d2301e18dd tempest-GroupSnapshotsTest-519473988 None] Delete group completed successfully. Jul 08 01:09:36 devstack sudo[92072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-920e4961-e638-4103-b96b-d81820bfa9ac req-6677a823-c3ea-43f8-ad10-bf0d1bb8c32c tempest-AttachVolumeTestJSON-1253782169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-920e4961-e638-4103-b96b-d81820bfa9ac req-6677a823-c3ea-43f8-ad10-bf0d1bb8c32c tempest-AttachVolumeTestJSON-1253782169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:37 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2244077-436a-4b5b-89aa-107c2d427afe]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-920e4961-e638-4103-b96b-d81820bfa9ac req-6677a823-c3ea-43f8-ad10-bf0d1bb8c32c tempest-AttachVolumeTestJSON-1253782169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b5f21dd4-9a7b-46c3-92c1-67241c03b050 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:37 devstack sudo[92072]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2b54486d-a685-4c1a-b397-c46863051112 tempest-GroupSnapshotsTest-519473988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e.dbf36dcb-9563-45fe-98d5-7e46b7417fdc" returned: 0 in 1.131s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:37 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-2b54486d-a685-4c1a-b397-c46863051112 tempest-GroupSnapshotsTest-519473988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bfab1e8-025d-4900-9839-f8964925952e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:09:37 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[450205f1-08cc-405e-882b-00cfbb12d50f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2b54486d-a685-4c1a-b397-c46863051112 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:37 devstack sudo[92089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b5f21dd4-9a7b-46c3-92c1-67241c03b050 Jul 08 01:09:37 devstack sudo[92089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:37 devstack sudo[92090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e Jul 08 01:09:37 devstack sudo[92090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:37 devstack sudo[92089]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-920e4961-e638-4103-b96b-d81820bfa9ac req-6677a823-c3ea-43f8-ad10-bf0d1bb8c32c tempest-AttachVolumeTestJSON-1253782169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b5f21dd4-9a7b-46c3-92c1-67241c03b050" returned: 0 in 0.953s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-920e4961-e638-4103-b96b-d81820bfa9ac req-6677a823-c3ea-43f8-ad10-bf0d1bb8c32c tempest-AttachVolumeTestJSON-1253782169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.985s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-920e4961-e638-4103-b96b-d81820bfa9ac req-6677a823-c3ea-43f8-ad10-bf0d1bb8c32c tempest-AttachVolumeTestJSON-1253782169 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d', 'name': 'volume-b5f21dd4-9a7b-46c3-92c1-67241c03b050', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '624b1ffa-a79f-4fa9-a348-6cb788de6a3a', 'enforce_multipath': True} {{(pid=87022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:09:38 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-920e4961-e638-4103-b96b-d81820bfa9ac req-6677a823-c3ea-43f8-ad10-bf0d1bb8c32c tempest-AttachVolumeTestJSON-1253782169 None] attachment_update completed successfully. Jul 08 01:09:38 devstack sudo[92090]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2b54486d-a685-4c1a-b397-c46863051112 tempest-GroupSnapshotsTest-519473988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e" returned: 0 in 1.342s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2b54486d-a685-4c1a-b397-c46863051112 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e.dbf36dcb-9563-45fe-98d5-7e46b7417fdc {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:38 devstack sudo[92100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e.dbf36dcb-9563-45fe-98d5-7e46b7417fdc Jul 08 01:09:38 devstack sudo[92100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:39 devstack sudo[92100]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2b54486d-a685-4c1a-b397-c46863051112 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e.dbf36dcb-9563-45fe-98d5-7e46b7417fdc" returned: 0 in 1.488s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2b54486d-a685-4c1a-b397-c46863051112 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e.dbf36dcb-9563-45fe-98d5-7e46b7417fdc {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:40 devstack sudo[92112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e.dbf36dcb-9563-45fe-98d5-7e46b7417fdc Jul 08 01:09:40 devstack sudo[92112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:40 devstack sudo[92112]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2b54486d-a685-4c1a-b397-c46863051112 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e.dbf36dcb-9563-45fe-98d5-7e46b7417fdc" returned: 0 in 0.872s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:40 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2b54486d-a685-4c1a-b397-c46863051112 tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-dbf36dcb-9563-45fe-98d5-7e46b7417fdc" released by "_delete_snapshot" :: held 5.034s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:09:40 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2b54486d-a685-4c1a-b397-c46863051112 tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-8bfab1e8-025d-4900-9839-f8964925952e" released by "delete_snapshot" :: held 5.074s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:09:40 devstack cinder-volume[87022]: WARNING cinder.quota [None req-2b54486d-a685-4c1a-b397-c46863051112 tempest-GroupSnapshotsTest-519473988 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-228886225 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-228886225, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:09:41 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-2b54486d-a685-4c1a-b397-c46863051112 tempest-GroupSnapshotsTest-519473988 None] Created reservations ['c9cfe24b-a5cc-495e-9dda-811966f19416', 'd572cbad-fcec-4a11-b408-10f2246779d2', '311e4e13-38b1-47f8-84d4-87b828cbfa33', '64cc3608-6432-4c61-a971-f9345f8bfdbe'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:09:41 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-2b54486d-a685-4c1a-b397-c46863051112 tempest-GroupSnapshotsTest-519473988 None] group_snapshot 6caae589-ede7-4c7a-9ecb-bfd3f09be957: deleted successfully Jul 08 01:09:41 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1b54fd5c-4c9b-4ff6-b6b4-522673ef5659 tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "cinder-quobyte-8bfab1e8-025d-4900-9839-f8964925952e" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1b54fd5c-4c9b-4ff6-b6b4-522673ef5659 tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-8bfab1e8-025d-4900-9839-f8964925952e" acquired by "delete_volume" :: waited 0.026s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:42 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8eb68a7-31f7-48f3-abc1-0b525f6c8c39]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1b54fd5c-4c9b-4ff6-b6b4-522673ef5659 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:42 devstack sudo[92140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e Jul 08 01:09:42 devstack sudo[92140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:43 devstack sudo[92140]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1b54fd5c-4c9b-4ff6-b6b4-522673ef5659 tempest-GroupSnapshotsTest-519473988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e" returned: 0 in 1.465s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1b54fd5c-4c9b-4ff6-b6b4-522673ef5659 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:43 devstack sudo[92148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e Jul 08 01:09:43 devstack sudo[92148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:44 devstack sudo[92148]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1b54fd5c-4c9b-4ff6-b6b4-522673ef5659 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8bfab1e8-025d-4900-9839-f8964925952e" returned: 0 in 0.952s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:44 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1b54fd5c-4c9b-4ff6-b6b4-522673ef5659 tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-8bfab1e8-025d-4900-9839-f8964925952e" released by "delete_volume" :: held 2.557s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:09:44 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-1b54fd5c-4c9b-4ff6-b6b4-522673ef5659 tempest-GroupSnapshotsTest-519473988 None] Created reservations ['574cc73e-7d28-437b-86ae-59beb75d196c'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:09:44 devstack cinder-volume[87022]: WARNING cinder.db.api [None req-1b54fd5c-4c9b-4ff6-b6b4-522673ef5659 tempest-GroupSnapshotsTest-519473988 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-228886225'] Jul 08 01:09:44 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-1b54fd5c-4c9b-4ff6-b6b4-522673ef5659 tempest-GroupSnapshotsTest-519473988 None] Created reservations ['42d0498e-2594-4a6d-ad10-928745441296', '2f18b35a-288f-41ed-a505-cd3304d9d541', '3a650931-14f3-4554-a4c5-0db6836c61a3', '6f36a414-a00c-4eb2-b021-ab88b14eb7c6'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:09:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1b54fd5c-4c9b-4ff6-b6b4-522673ef5659 tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1b54fd5c-4c9b-4ff6-b6b4-522673ef5659 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1b54fd5c-4c9b-4ff6-b6b4-522673ef5659 tempest-GroupSnapshotsTest-519473988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1b54fd5c-4c9b-4ff6-b6b4-522673ef5659 tempest-GroupSnapshotsTest-519473988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1b54fd5c-4c9b-4ff6-b6b4-522673ef5659 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1b54fd5c-4c9b-4ff6-b6b4-522673ef5659 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:44 devstack sudo[92158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:09:44 devstack sudo[92158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:45 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:09:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:45 devstack sudo[92160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:09:45 devstack sudo[92160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:45 devstack sudo[92158]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1b54fd5c-4c9b-4ff6-b6b4-522673ef5659 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.922s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:45 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-1b54fd5c-4c9b-4ff6-b6b4-522673ef5659 tempest-GroupSnapshotsTest-519473988 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:09:45 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-1b54fd5c-4c9b-4ff6-b6b4-522673ef5659 tempest-GroupSnapshotsTest-519473988 None] Delete group completed successfully. Jul 08 01:09:46 devstack sudo[92160]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.120s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:46 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:09:46 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:09:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread count: 8 {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:09:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread info: [<_MainThread(MainThread, started 134382216167552)>, , , , , , , ] {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:09:46 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-15cc735e-b797-4b53-82b1-5f28cb1f7dfb tempest-GroupSnapshotsTest-519473988 None] Group tempest-GroupSnapshotsTest-Group-1686569118: creating Jul 08 01:09:46 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-15cc735e-b797-4b53-82b1-5f28cb1f7dfb tempest-GroupSnapshotsTest-519473988 None] Group tempest-GroupSnapshotsTest-Group-1686569118: created successfully Jul 08 01:09:46 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-15cc735e-b797-4b53-82b1-5f28cb1f7dfb tempest-GroupSnapshotsTest-519473988 None] Create group completed successfully. Jul 08 01:09:48 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:09:48 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Flow 'volume_create_manager' (f6787eb6-d943-4db2-a1c2-be1641cbc2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:48 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e940d9f-c83a-49e8-8f60-b3b7f74b9c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:48 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e940d9f-c83a-49e8-8f60-b3b7f74b9c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-377592713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=11e2cbad-739a-4f39-b3c1-cfac1c98a01c,host='devstack@QuobyteHD#QuobyteHD',id=f475fe79-2ce9-4fcd-aa6a-4c7a65021452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952061960b6b47b890c81f0caf6827db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:49Z,use_quota=True,user_id='49f97b0edcd94544ae5cb386dcb76b4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43200b74-cb34-4630-8db9-daf42d18ad90),volume_type_id=43200b74-cb34-4630-8db9-daf42d18ad90)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:48 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087aefe9-e667-4d76-a080-71df3a97799a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:48 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087aefe9-e667-4d76-a080-71df3a97799a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:48 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76af772d-8541-4c4b-9fa7-e8a9d162258e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:48 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76af772d-8541-4c4b-9fa7-e8a9d162258e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f475fe79-2ce9-4fcd-aa6a-4c7a65021452', 'volume_name': 'volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:48 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4a77a8-e6ff-4cc4-850e-4dba59850648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:48 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4a77a8-e6ff-4cc4-850e-4dba59850648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:48 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (800104a9-86c5-4a67-8522-b548c5541f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:48 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Volume f475fe79-2ce9-4fcd-aa6a-4c7a65021452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452', 'volume_size': 1} Jul 08 01:09:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:48 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=11e2cbad-739a-4f39-b3c1-cfac1c98a01c,created_at=2026-07-07T23:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-377592713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=11e2cbad-739a-4f39-b3c1-cfac1c98a01c,host='devstack@QuobyteHD#QuobyteHD',id=f475fe79-2ce9-4fcd-aa6a-4c7a65021452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952061960b6b47b890c81f0caf6827db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:49Z,use_quota=True,user_id='49f97b0edcd94544ae5cb386dcb76b4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43200b74-cb34-4630-8db9-daf42d18ad90),volume_type_id=43200b74-cb34-4630-8db9-daf42d18ad90)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:09:48 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Creating volume f475fe79-2ce9-4fcd-aa6a-4c7a65021452 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:09:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:48 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:48 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:48 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:09:48 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:09:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:48 devstack sudo[92166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452 1073741824 Jul 08 01:09:48 devstack sudo[92166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:49 devstack sudo[92166]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452 1073741824" returned: 0 in 1.046s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:49 devstack sudo[92172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452 Jul 08 01:09:49 devstack sudo[92172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:50 devstack sudo[92172]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452" returned: 0 in 0.848s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:50 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] <== create_volume: return (1955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:09:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:50 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (800104a9-86c5-4a67-8522-b548c5541f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:50 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec989d55-c4f6-4cde-b3b9-553762d5d8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:50 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Volume volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452 (f475fe79-2ce9-4fcd-aa6a-4c7a65021452): created successfully Jul 08 01:09:50 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec989d55-c4f6-4cde-b3b9-553762d5d8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:50 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Flow 'volume_create_manager' (f6787eb6-d943-4db2-a1c2-be1641cbc2ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:50 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-b3447791-fb2e-426f-ac90-0b8234562177 tempest-GroupSnapshotsTest-519473988 None] Created volume successfully. Jul 08 01:09:52 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:09:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Flow 'volume_create_manager' (e13d122e-79d2-4f79-8fda-71af1557fad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd6b971e-8b6d-4683-a4c7-c05a52ed1758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd6b971e-8b6d-4683-a4c7-c05a52ed1758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-722601789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=11e2cbad-739a-4f39-b3c1-cfac1c98a01c,host='devstack@QuobyteHD#QuobyteHD',id=588eb568-31ab-44fb-9a75-29a34f4e897c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952061960b6b47b890c81f0caf6827db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:52Z,use_quota=True,user_id='49f97b0edcd94544ae5cb386dcb76b4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43200b74-cb34-4630-8db9-daf42d18ad90),volume_type_id=43200b74-cb34-4630-8db9-daf42d18ad90)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18649eac-b5b4-448e-89ab-cb04b0694694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18649eac-b5b4-448e-89ab-cb04b0694694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7628a1cb-c43d-4724-9766-cd27b3692b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7628a1cb-c43d-4724-9766-cd27b3692b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '588eb568-31ab-44fb-9a75-29a34f4e897c', 'volume_name': 'volume-588eb568-31ab-44fb-9a75-29a34f4e897c', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec8463a-dbdf-46ca-bc0b-ddab92f25bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec8463a-dbdf-46ca-bc0b-ddab92f25bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b0bbff-9cad-4824-86a9-950ae671288c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:52 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Volume 588eb568-31ab-44fb-9a75-29a34f4e897c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-588eb568-31ab-44fb-9a75-29a34f4e897c', 'volume_size': 1} Jul 08 01:09:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=11e2cbad-739a-4f39-b3c1-cfac1c98a01c,created_at=2026-07-07T23:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-722601789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=11e2cbad-739a-4f39-b3c1-cfac1c98a01c,host='devstack@QuobyteHD#QuobyteHD',id=588eb568-31ab-44fb-9a75-29a34f4e897c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952061960b6b47b890c81f0caf6827db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:52Z,use_quota=True,user_id='49f97b0edcd94544ae5cb386dcb76b4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43200b74-cb34-4630-8db9-daf42d18ad90),volume_type_id=43200b74-cb34-4630-8db9-daf42d18ad90)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:09:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Creating volume 588eb568-31ab-44fb-9a75-29a34f4e897c {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:09:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:09:52 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:09:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:52 devstack sudo[92180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c 1073741824 Jul 08 01:09:52 devstack sudo[92180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:52 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-60b3c706-af11-4acd-b822-a634b5b6ef1c req-bea7fc70-15ce-41cb-ba35-0d35d87dbaec tempest-AttachVolumeNegativeTest-54008946 None] Terminate volume connection completed successfully. Jul 08 01:09:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-60b3c706-af11-4acd-b822-a634b5b6ef1c req-bea7fc70-15ce-41cb-ba35-0d35d87dbaec tempest-AttachVolumeNegativeTest-54008946 None] Deleting attachment 37df93b5-ac9c-4b69-be9d-3b818866a0a0. {{(pid=87022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:09:53 devstack sudo[92180]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c 1073741824" returned: 0 in 1.387s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:53 devstack sudo[92200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c Jul 08 01:09:53 devstack sudo[92200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:54 devstack sudo[92200]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c" returned: 0 in 1.295s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:54 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] <== create_volume: return (2765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:09:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.767s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b0bbff-9cad-4824-86a9-950ae671288c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-588eb568-31ab-44fb-9a75-29a34f4e897c', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f6d8621-7098-4952-89d6-c44118ac39de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:55 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Volume volume-588eb568-31ab-44fb-9a75-29a34f4e897c (588eb568-31ab-44fb-9a75-29a34f4e897c): created successfully Jul 08 01:09:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f6d8621-7098-4952-89d6-c44118ac39de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Flow 'volume_create_manager' (e13d122e-79d2-4f79-8fda-71af1557fad6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:55 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-2a66b52e-88e5-4788-8ad5-e3d21c51bbb3 tempest-GroupSnapshotsTest-519473988 None] Created volume successfully. Jul 08 01:09:56 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-4fdab6e0-54de-4c68-b491-16be0a0b1f61 tempest-GroupSnapshotsTest-519473988 None] Update group completed successfully. Jul 08 01:09:57 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-722ea120-31fa-4607-853c-691de1a9fc4d tempest-GroupSnapshotsTest-519473988 None] Update group completed successfully. Jul 08 01:09:59 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-4d2595a1-614a-43b2-9044-03b9d69e4e92 tempest-GroupSnapshotsTest-519473988 None] Update group completed successfully. Jul 08 01:10:00 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=66,cinder:UPDATE=60,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:10:00 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-5988c59a-bb84-41f4-bc89-500e332acf31 tempest-GroupSnapshotsTest-519473988 None] Update group completed successfully. Jul 08 01:10:02 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] GroupSnapshot ccefa831-a299-410e-ae6a-17e0d54a93d8: creating. Jul 08 01:10:02 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=67,cinder:UPDATE=56,cinder:DELETE=3,cinder:INSERT=12 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:10:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] Group snapshot ccefa831-a299-410e-ae6a-17e0d54a93d8: creating. {{(pid=87022) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 01:10:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] Creating offline snapshot 0b31cb96-39db-4da7-826a-0b95328c4dc5 of volume 588eb568-31ab-44fb-9a75-29a34f4e897c {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:10:02 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71ea8f3-64d1-4b8c-a023-9907ca088b53]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:02 devstack sudo[92735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c Jul 08 01:10:02 devstack sudo[92735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:03 devstack sudo[92735]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c" returned: 0 in 1.118s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c.0b31cb96-39db-4da7-826a-0b95328c4dc5 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:03 devstack sudo[92740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c.0b31cb96-39db-4da7-826a-0b95328c4dc5 1G Jul 08 01:10:03 devstack sudo[92740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:04 devstack sudo[92740]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c.0b31cb96-39db-4da7-826a-0b95328c4dc5 1G" returned: 0 in 1.069s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-588eb568-31ab-44fb-9a75-29a34f4e897c -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c.0b31cb96-39db-4da7-826a-0b95328c4dc5 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:04 devstack sudo[92745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-588eb568-31ab-44fb-9a75-29a34f4e897c -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c.0b31cb96-39db-4da7-826a-0b95328c4dc5 Jul 08 01:10:04 devstack sudo[92745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:06 devstack sudo[92745]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-588eb568-31ab-44fb-9a75-29a34f4e897c -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c.0b31cb96-39db-4da7-826a-0b95328c4dc5" returned: 0 in 1.657s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:06 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c.0b31cb96-39db-4da7-826a-0b95328c4dc5 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:10:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c.0b31cb96-39db-4da7-826a-0b95328c4dc5 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:06 devstack sudo[92754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c.0b31cb96-39db-4da7-826a-0b95328c4dc5 Jul 08 01:10:06 devstack sudo[92754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:07 devstack sudo[92754]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c.0b31cb96-39db-4da7-826a-0b95328c4dc5" returned: 0 in 1.102s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:07 devstack sudo[92762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c.info Jul 08 01:10:07 devstack sudo[92762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:08 devstack sudo[92762]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c.info" returned: 0 in 0.955s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:08 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:10:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:08 devstack sudo[92768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c.info Jul 08 01:10:08 devstack sudo[92768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:09 devstack sudo[92768]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c.info" returned: 0 in 0.920s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.031s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] Creating offline snapshot ebf1ea48-aa97-4970-bc7c-6ec54d69580d of volume f475fe79-2ce9-4fcd-aa6a-4c7a65021452 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:10:09 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6e70f2-bfc3-4ad7-844e-98b02995e482]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:09 devstack sudo[92771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452 Jul 08 01:10:09 devstack sudo[92771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:10 devstack sudo[92771]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452" returned: 0 in 0.905s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452.ebf1ea48-aa97-4970-bc7c-6ec54d69580d 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:10 devstack sudo[92776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452.ebf1ea48-aa97-4970-bc7c-6ec54d69580d 1G Jul 08 01:10:10 devstack sudo[92776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:11 devstack sudo[92776]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452.ebf1ea48-aa97-4970-bc7c-6ec54d69580d 1G" returned: 0 in 1.125s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452.ebf1ea48-aa97-4970-bc7c-6ec54d69580d {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:11 devstack sudo[92782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452.ebf1ea48-aa97-4970-bc7c-6ec54d69580d Jul 08 01:10:11 devstack sudo[92782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:13 devstack sudo[92782]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452.ebf1ea48-aa97-4970-bc7c-6ec54d69580d" returned: 0 in 1.699s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:13 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452.ebf1ea48-aa97-4970-bc7c-6ec54d69580d is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:10:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452.ebf1ea48-aa97-4970-bc7c-6ec54d69580d {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:13 devstack sudo[92800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452.ebf1ea48-aa97-4970-bc7c-6ec54d69580d Jul 08 01:10:13 devstack sudo[92800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:14 devstack sudo[92800]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452.ebf1ea48-aa97-4970-bc7c-6ec54d69580d" returned: 0 in 1.097s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:14 devstack sudo[92848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452.info Jul 08 01:10:14 devstack sudo[92848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:15 devstack sudo[92848]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452.info" returned: 0 in 0.906s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:15 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:10:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:15 devstack sudo[92852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452.info Jul 08 01:10:15 devstack sudo[92852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:16 devstack sudo[92852]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452.info" returned: 0 in 0.912s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.745s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:16 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-6b31f15e-4f9b-4cbe-9082-e8b3c00e14be tempest-GroupSnapshotsTest-519473988 None] group_snapshot ccefa831-a299-410e-ae6a-17e0d54a93d8: created successfully Jul 08 01:10:16 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] group_snapshot ccefa831-a299-410e-ae6a-17e0d54a93d8: deleting Jul 08 01:10:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] group_snapshot ccefa831-a299-410e-ae6a-17e0d54a93d8: deleting {{(pid=87022) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 01:10:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "cinder-quobyte-588eb568-31ab-44fb-9a75-29a34f4e897c" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-588eb568-31ab-44fb-9a75-29a34f4e897c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "cinder-quobyte-0b31cb96-39db-4da7-826a-0b95328c4dc5" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-0b31cb96-39db-4da7-826a-0b95328c4dc5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] Deleting offline snapshot 0b31cb96-39db-4da7-826a-0b95328c4dc5 of volume 588eb568-31ab-44fb-9a75-29a34f4e897c {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:10:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] snapshot_file for this snap is: volume-588eb568-31ab-44fb-9a75-29a34f4e897c.0b31cb96-39db-4da7-826a-0b95328c4dc5 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:10:16 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5a0669-fb94-46b3-a2b0-b7b24dc048be]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c.0b31cb96-39db-4da7-826a-0b95328c4dc5 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:16 devstack sudo[92873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c.0b31cb96-39db-4da7-826a-0b95328c4dc5 Jul 08 01:10:16 devstack sudo[92873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:17 devstack sudo[92873]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c.0b31cb96-39db-4da7-826a-0b95328c4dc5" returned: 0 in 0.958s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-588eb568-31ab-44fb-9a75-29a34f4e897c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:10:17 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69ce313-8eea-4b3b-9d8c-65e004e463af]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:17 devstack sudo[92879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c Jul 08 01:10:17 devstack sudo[92879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:19 devstack sudo[92879]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c" returned: 0 in 1.377s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c.0b31cb96-39db-4da7-826a-0b95328c4dc5 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:19 devstack sudo[92919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c.0b31cb96-39db-4da7-826a-0b95328c4dc5 Jul 08 01:10:19 devstack sudo[92919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:20 devstack sudo[92919]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c.0b31cb96-39db-4da7-826a-0b95328c4dc5" returned: 0 in 1.610s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c.0b31cb96-39db-4da7-826a-0b95328c4dc5 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:20 devstack sudo[92985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c.0b31cb96-39db-4da7-826a-0b95328c4dc5 Jul 08 01:10:20 devstack sudo[92985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:22 devstack sudo[92985]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c.0b31cb96-39db-4da7-826a-0b95328c4dc5" returned: 0 in 1.214s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-0b31cb96-39db-4da7-826a-0b95328c4dc5" released by "_delete_snapshot" :: held 5.324s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-588eb568-31ab-44fb-9a75-29a34f4e897c" released by "delete_snapshot" :: held 5.356s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "cinder-quobyte-f475fe79-2ce9-4fcd-aa6a-4c7a65021452" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-f475fe79-2ce9-4fcd-aa6a-4c7a65021452" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "cinder-quobyte-ebf1ea48-aa97-4970-bc7c-6ec54d69580d" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-ebf1ea48-aa97-4970-bc7c-6ec54d69580d" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:22 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] Deleting offline snapshot ebf1ea48-aa97-4970-bc7c-6ec54d69580d of volume f475fe79-2ce9-4fcd-aa6a-4c7a65021452 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:10:22 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] snapshot_file for this snap is: volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452.ebf1ea48-aa97-4970-bc7c-6ec54d69580d {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:10:22 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ad10d8-212a-4c35-94be-e126f5ec87d7]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452.ebf1ea48-aa97-4970-bc7c-6ec54d69580d {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:22 devstack sudo[93017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452.ebf1ea48-aa97-4970-bc7c-6ec54d69580d Jul 08 01:10:22 devstack sudo[93017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:23 devstack sudo[93017]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452.ebf1ea48-aa97-4970-bc7c-6ec54d69580d" returned: 0 in 1.455s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:10:23 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b391c5-8712-4176-bd25-29e2e84c8783]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:24 devstack sudo[93029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452 Jul 08 01:10:24 devstack sudo[93029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:24 devstack sudo[93029]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452" returned: 0 in 1.165s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452.ebf1ea48-aa97-4970-bc7c-6ec54d69580d {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:25 devstack sudo[93035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452.ebf1ea48-aa97-4970-bc7c-6ec54d69580d Jul 08 01:10:25 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:26 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452.ebf1ea48-aa97-4970-bc7c-6ec54d69580d" returned: 0 in 1.291s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452.ebf1ea48-aa97-4970-bc7c-6ec54d69580d {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:26 devstack sudo[93043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452.ebf1ea48-aa97-4970-bc7c-6ec54d69580d Jul 08 01:10:26 devstack sudo[93043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:26 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:10:27 devstack sudo[93043]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452.ebf1ea48-aa97-4970-bc7c-6ec54d69580d" returned: 0 in 1.291s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-ebf1ea48-aa97-4970-bc7c-6ec54d69580d" released by "_delete_snapshot" :: held 5.433s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-f475fe79-2ce9-4fcd-aa6a-4c7a65021452" released by "delete_snapshot" :: held 5.476s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:27 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-c3f608c3-fee1-41c6-b7d2-23fee0fe8836 req-7ea5344b-3994-4297-a83e-096d91508488 tempest-AttachVolumeTestJSON-1253782169 None] Terminate volume connection completed successfully. Jul 08 01:10:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-c3f608c3-fee1-41c6-b7d2-23fee0fe8836 req-7ea5344b-3994-4297-a83e-096d91508488 tempest-AttachVolumeTestJSON-1253782169 None] Deleting attachment 624b1ffa-a79f-4fa9-a348-6cb788de6a3a. {{(pid=87022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:10:27 devstack cinder-volume[87022]: WARNING cinder.quota [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1789368371 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1789368371, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:10:27 devstack cinder-volume[87022]: WARNING cinder.quota [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1789368371 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1789368371, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:10:28 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] Created reservations ['afb06c49-ffdf-49ec-a011-261d86694eba', 'f9df644d-ae44-4af3-8c8e-d4acc1b2dd81', '6b665626-8066-41b9-a4cf-0a564bcb59fe', '23900df1-ef8d-4bb2-9121-49fa1f2df1ad'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:10:28 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] Created reservations ['e13bbeb7-c659-42ca-b434-86ee1c4ebeff', '2270521f-2798-4315-a128-1b2de0c1e475', 'e04b184e-15fe-4f79-9e3a-e175b509e3a3', '773278d4-c47a-418d-afc8-4f7462e08599'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:10:28 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-041bfb79-02e7-423d-8f41-85e6b787f7b8 tempest-GroupSnapshotsTest-519473988 None] group_snapshot ccefa831-a299-410e-ae6a-17e0d54a93d8: deleted successfully Jul 08 01:10:29 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4edd32ab-b98f-4847-883a-a1093b928af5 tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "cinder-quobyte-588eb568-31ab-44fb-9a75-29a34f4e897c" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:29 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4edd32ab-b98f-4847-883a-a1093b928af5 tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-588eb568-31ab-44fb-9a75-29a34f4e897c" acquired by "delete_volume" :: waited 0.024s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:29 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6fc7c3-5b2d-4b26-80c9-6afe5e006591]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4edd32ab-b98f-4847-883a-a1093b928af5 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:30 devstack sudo[93117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c Jul 08 01:10:30 devstack sudo[93117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:31 devstack sudo[93117]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4edd32ab-b98f-4847-883a-a1093b928af5 tempest-GroupSnapshotsTest-519473988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c" returned: 0 in 1.500s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4edd32ab-b98f-4847-883a-a1093b928af5 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:31 devstack sudo[93128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c Jul 08 01:10:31 devstack sudo[93128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:32 devstack sudo[93128]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4edd32ab-b98f-4847-883a-a1093b928af5 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-588eb568-31ab-44fb-9a75-29a34f4e897c" returned: 0 in 0.836s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:32 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4edd32ab-b98f-4847-883a-a1093b928af5 tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-588eb568-31ab-44fb-9a75-29a34f4e897c" released by "delete_volume" :: held 2.432s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:32 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4edd32ab-b98f-4847-883a-a1093b928af5 tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "cinder-quobyte-f475fe79-2ce9-4fcd-aa6a-4c7a65021452" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:32 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4edd32ab-b98f-4847-883a-a1093b928af5 tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-f475fe79-2ce9-4fcd-aa6a-4c7a65021452" acquired by "delete_volume" :: waited 0.075s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:32 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfb5a5b-c24d-4eb6-becd-43ced4978d72]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4edd32ab-b98f-4847-883a-a1093b928af5 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:32 devstack sudo[93142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452 Jul 08 01:10:32 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:33 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4edd32ab-b98f-4847-883a-a1093b928af5 tempest-GroupSnapshotsTest-519473988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452" returned: 0 in 1.329s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4edd32ab-b98f-4847-883a-a1093b928af5 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:33 devstack sudo[93148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452 Jul 08 01:10:33 devstack sudo[93148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:35 devstack sudo[93148]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4edd32ab-b98f-4847-883a-a1093b928af5 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f475fe79-2ce9-4fcd-aa6a-4c7a65021452" returned: 0 in 1.149s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4edd32ab-b98f-4847-883a-a1093b928af5 tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-f475fe79-2ce9-4fcd-aa6a-4c7a65021452" released by "delete_volume" :: held 2.664s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:35 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-4edd32ab-b98f-4847-883a-a1093b928af5 tempest-GroupSnapshotsTest-519473988 None] Created reservations ['f4df7f91-8fa8-4213-a6b9-0435147922aa'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:10:35 devstack cinder-volume[87022]: WARNING cinder.quota [None req-4edd32ab-b98f-4847-883a-a1093b928af5 tempest-GroupSnapshotsTest-519473988 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1789368371 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1789368371, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:10:35 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-4edd32ab-b98f-4847-883a-a1093b928af5 tempest-GroupSnapshotsTest-519473988 None] Created reservations ['18ca40ca-b103-48f3-b553-3547cac7826a', '5f2e1012-8683-4df4-ac50-800e7be0a37a', '66324b36-9a46-4f4b-8d94-e8efbd6e41f5', 'a6f5bb25-6a29-44da-9cd9-a2b796a3350b'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:10:35 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-4edd32ab-b98f-4847-883a-a1093b928af5 tempest-GroupSnapshotsTest-519473988 None] Created reservations ['1a8e2799-4749-455b-bed3-f95b8ca1b7a5', '8111d79a-bf56-42ac-af3f-9ab8d889e649', '3ec00445-12bb-402b-89f8-431a24bafa82', '57dd738d-878d-4f83-9c17-3be53e3d328f'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:10:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4edd32ab-b98f-4847-883a-a1093b928af5 tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4edd32ab-b98f-4847-883a-a1093b928af5 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:35 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4edd32ab-b98f-4847-883a-a1093b928af5 tempest-GroupSnapshotsTest-519473988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:35 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4edd32ab-b98f-4847-883a-a1093b928af5 tempest-GroupSnapshotsTest-519473988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4edd32ab-b98f-4847-883a-a1093b928af5 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4edd32ab-b98f-4847-883a-a1093b928af5 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:36 devstack sudo[93155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:10:36 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:37 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4edd32ab-b98f-4847-883a-a1093b928af5 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.694s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:37 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-4edd32ab-b98f-4847-883a-a1093b928af5 tempest-GroupSnapshotsTest-519473988 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:10:37 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-4edd32ab-b98f-4847-883a-a1093b928af5 tempest-GroupSnapshotsTest-519473988 None] Delete group completed successfully. Jul 08 01:10:37 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-91be273f-ab85-4646-9613-dbbde35c00f6 tempest-GroupSnapshotsTest-519473988 None] Group tempest-GroupSnapshotsTest-Group-1994431916: creating Jul 08 01:10:37 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-91be273f-ab85-4646-9613-dbbde35c00f6 tempest-GroupSnapshotsTest-519473988 None] Group tempest-GroupSnapshotsTest-Group-1994431916: created successfully Jul 08 01:10:37 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-91be273f-ab85-4646-9613-dbbde35c00f6 tempest-GroupSnapshotsTest-519473988 None] Create group completed successfully. Jul 08 01:10:40 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:10:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Flow 'volume_create_manager' (9c7ae112-8d37-43b2-8fc9-c03794e83511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:10:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e5841b1-e64a-4e54-a460-317e32bcdacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e5841b1-e64a-4e54-a460-317e32bcdacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1428435761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=08a85ae1-14d4-4a47-bb87-9ffff33d0936,host='devstack@QuobyteHD#QuobyteHD',id=14dd3d6f-df6c-482d-a106-7999ae11a7d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952061960b6b47b890c81f0caf6827db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:10:40Z,use_quota=True,user_id='49f97b0edcd94544ae5cb386dcb76b4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(939af9f2-91fe-4b79-ba2f-807ca3d0f0ac),volume_type_id=939af9f2-91fe-4b79-ba2f-807ca3d0f0ac)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce065ea5-5b6f-4124-8602-37fd33c40782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce065ea5-5b6f-4124-8602-37fd33c40782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80b0a52-4e95-4e00-9601-55a20bbc86ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80b0a52-4e95-4e00-9601-55a20bbc86ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14dd3d6f-df6c-482d-a106-7999ae11a7d8', 'volume_name': 'volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a40817-138f-425a-b0f7-25c88883e007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a40817-138f-425a-b0f7-25c88883e007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee58053-e73b-41fc-adb0-665b165ee37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:40 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Volume 14dd3d6f-df6c-482d-a106-7999ae11a7d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8', 'volume_size': 1} Jul 08 01:10:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:40 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=08a85ae1-14d4-4a47-bb87-9ffff33d0936,created_at=2026-07-07T23:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1428435761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=08a85ae1-14d4-4a47-bb87-9ffff33d0936,host='devstack@QuobyteHD#QuobyteHD',id=14dd3d6f-df6c-482d-a106-7999ae11a7d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952061960b6b47b890c81f0caf6827db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:10:40Z,use_quota=True,user_id='49f97b0edcd94544ae5cb386dcb76b4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(939af9f2-91fe-4b79-ba2f-807ca3d0f0ac),volume_type_id=939af9f2-91fe-4b79-ba2f-807ca3d0f0ac)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:10:40 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Creating volume 14dd3d6f-df6c-482d-a106-7999ae11a7d8 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:10:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:40 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:40 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:40 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:10:40 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:10:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:40 devstack sudo[93227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8 1073741824 Jul 08 01:10:40 devstack sudo[93227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:42 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:10:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Flow 'volume_create_manager' (f0e72942-5b42-4022-9696-764b5f636448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:10:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f0b6e81-2a36-4ad5-8643-97287f6e7a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f0b6e81-2a36-4ad5-8643-97287f6e7a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1232672069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74ddfe47-afb2-4227-b869-1cdd135bd0ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff4ed34710de4aa6a14d360ee999d0be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:10:42Z,use_quota=True,user_id='cb8ed47e83534a3cb4b54a8a22e6d23f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59fe1a5a-b4de-4c87-8224-94bf29ea5330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59fe1a5a-b4de-4c87-8224-94bf29ea5330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed8586a-3883-483b-9b74-a975e0e20bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed8586a-3883-483b-9b74-a975e0e20bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74ddfe47-afb2-4227-b869-1cdd135bd0ed', 'volume_name': 'volume-74ddfe47-afb2-4227-b869-1cdd135bd0ed', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba68581-35ac-4869-99d5-6b786d360c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba68581-35ac-4869-99d5-6b786d360c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d636812-b09b-4a56-96ec-0e30e7b4123c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:42 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Volume 74ddfe47-afb2-4227-b869-1cdd135bd0ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74ddfe47-afb2-4227-b869-1cdd135bd0ed', 'volume_size': 1} Jul 08 01:10:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:42 devstack sudo[93227]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8 1073741824" returned: 0 in 2.003s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:42 devstack sudo[93248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8 Jul 08 01:10:42 devstack sudo[93248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:44 devstack sudo[93248]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8" returned: 0 in 1.942s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] <== create_volume: return (4011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:10:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.018s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.412s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1232672069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74ddfe47-afb2-4227-b869-1cdd135bd0ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff4ed34710de4aa6a14d360ee999d0be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:10:42Z,use_quota=True,user_id='cb8ed47e83534a3cb4b54a8a22e6d23f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:10:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Creating volume 74ddfe47-afb2-4227-b869-1cdd135bd0ed {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:10:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:10:44 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:10:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-74ddfe47-afb2-4227-b869-1cdd135bd0ed 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee58053-e73b-41fc-adb0-665b165ee37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b07a5ea-0f78-4fbd-b147-4951d0c27df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:44 devstack sudo[93311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-74ddfe47-afb2-4227-b869-1cdd135bd0ed 1073741824 Jul 08 01:10:44 devstack sudo[93311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:44 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Volume volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8 (14dd3d6f-df6c-482d-a106-7999ae11a7d8): created successfully Jul 08 01:10:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b07a5ea-0f78-4fbd-b147-4951d0c27df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Flow 'volume_create_manager' (9c7ae112-8d37-43b2-8fc9-c03794e83511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:10:44 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-c1ba7302-900f-48ec-8e21-1f6cfbfc30b3 tempest-GroupSnapshotsTest-519473988 None] Created volume successfully. Jul 08 01:10:45 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:10:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:45 devstack sudo[93320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:10:45 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:46 devstack sudo[93311]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-74ddfe47-afb2-4227-b869-1cdd135bd0ed 1073741824" returned: 0 in 1.921s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-74ddfe47-afb2-4227-b869-1cdd135bd0ed {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:46 devstack sudo[93330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-74ddfe47-afb2-4227-b869-1cdd135bd0ed Jul 08 01:10:46 devstack sudo[93330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:47 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.652s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:47 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:10:47 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:10:47 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread count: 8 {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:10:47 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread info: [<_MainThread(MainThread, started 134382216167552)>, , , , , , , ] {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:10:47 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-346c7a90-9a87-4515-9907-69653bcfc574 tempest-GroupSnapshotsTest-519473988 None] GroupSnapshot 0f506bb9-2b3f-46b8-a45c-aac5ac11f28c: creating. Jul 08 01:10:47 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-346c7a90-9a87-4515-9907-69653bcfc574 tempest-GroupSnapshotsTest-519473988 None] Group snapshot 0f506bb9-2b3f-46b8-a45c-aac5ac11f28c: creating. {{(pid=87022) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 01:10:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-346c7a90-9a87-4515-9907-69653bcfc574 tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:47 devstack sudo[93330]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-74ddfe47-afb2-4227-b869-1cdd135bd0ed" returned: 0 in 1.249s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:47 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] <== create_volume: return (3262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:10:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.266s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-346c7a90-9a87-4515-9907-69653bcfc574 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.356s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:48 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d636812-b09b-4a56-96ec-0e30e7b4123c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74ddfe47-afb2-4227-b869-1cdd135bd0ed', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:48 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c01088-ec57-49bf-8e30-a0ac02bd258e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:48 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-346c7a90-9a87-4515-9907-69653bcfc574 tempest-GroupSnapshotsTest-519473988 None] Creating offline snapshot 265ddb2e-755e-42c1-be3e-4986f7745b41 of volume 14dd3d6f-df6c-482d-a106-7999ae11a7d8 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:10:48 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Volume volume-74ddfe47-afb2-4227-b869-1cdd135bd0ed (74ddfe47-afb2-4227-b869-1cdd135bd0ed): created successfully Jul 08 01:10:48 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c01088-ec57-49bf-8e30-a0ac02bd258e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:48 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Flow 'volume_create_manager' (f0e72942-5b42-4022-9696-764b5f636448) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:10:48 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5fe102-e3d6-4743-bb52-785e0743801f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-346c7a90-9a87-4515-9907-69653bcfc574 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:48 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-e3c99387-3cf3-477d-a9ca-2905629d82d4 tempest-ServerRescueNegativeTestJSON-1690878936 None] Created volume successfully. Jul 08 01:10:48 devstack sudo[93360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8 Jul 08 01:10:48 devstack sudo[93360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:49 devstack sudo[93360]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-346c7a90-9a87-4515-9907-69653bcfc574 tempest-GroupSnapshotsTest-519473988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8" returned: 0 in 0.977s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-346c7a90-9a87-4515-9907-69653bcfc574 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8.265ddb2e-755e-42c1-be3e-4986f7745b41 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:49 devstack sudo[93366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8.265ddb2e-755e-42c1-be3e-4986f7745b41 1G Jul 08 01:10:49 devstack sudo[93366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:50 devstack sudo[93366]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-346c7a90-9a87-4515-9907-69653bcfc574 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8.265ddb2e-755e-42c1-be3e-4986f7745b41 1G" returned: 0 in 1.003s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-346c7a90-9a87-4515-9907-69653bcfc574 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8.265ddb2e-755e-42c1-be3e-4986f7745b41 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:50 devstack sudo[93373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8.265ddb2e-755e-42c1-be3e-4986f7745b41 Jul 08 01:10:50 devstack sudo[93373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:51 devstack sudo[93373]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-346c7a90-9a87-4515-9907-69653bcfc574 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8.265ddb2e-755e-42c1-be3e-4986f7745b41" returned: 0 in 0.986s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:51 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-346c7a90-9a87-4515-9907-69653bcfc574 tempest-GroupSnapshotsTest-519473988 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8.265ddb2e-755e-42c1-be3e-4986f7745b41 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:10:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-346c7a90-9a87-4515-9907-69653bcfc574 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8.265ddb2e-755e-42c1-be3e-4986f7745b41 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:51 devstack sudo[93378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8.265ddb2e-755e-42c1-be3e-4986f7745b41 Jul 08 01:10:51 devstack sudo[93378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:51 devstack sudo[93378]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-346c7a90-9a87-4515-9907-69653bcfc574 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8.265ddb2e-755e-42c1-be3e-4986f7745b41" returned: 0 in 0.731s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-346c7a90-9a87-4515-9907-69653bcfc574 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:51 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8.info Jul 08 01:10:51 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:52 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-346c7a90-9a87-4515-9907-69653bcfc574 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8.info" returned: 0 in 0.791s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:52 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-346c7a90-9a87-4515-9907-69653bcfc574 tempest-GroupSnapshotsTest-519473988 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:10:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-346c7a90-9a87-4515-9907-69653bcfc574 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:52 devstack sudo[93384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8.info Jul 08 01:10:52 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:53 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-346c7a90-9a87-4515-9907-69653bcfc574 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8.info" returned: 0 in 0.686s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-346c7a90-9a87-4515-9907-69653bcfc574 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.311s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:53 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-346c7a90-9a87-4515-9907-69653bcfc574 tempest-GroupSnapshotsTest-519473988 None] group_snapshot 0f506bb9-2b3f-46b8-a45c-aac5ac11f28c: created successfully Jul 08 01:10:54 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-40189699-e814-46a6-b598-bbb98ab21c8f tempest-GroupSnapshotsTest-519473988 None] group_snapshot 0f506bb9-2b3f-46b8-a45c-aac5ac11f28c: deleting Jul 08 01:10:54 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-40189699-e814-46a6-b598-bbb98ab21c8f tempest-GroupSnapshotsTest-519473988 None] group_snapshot 0f506bb9-2b3f-46b8-a45c-aac5ac11f28c: deleting {{(pid=87022) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 01:10:54 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-40189699-e814-46a6-b598-bbb98ab21c8f tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "cinder-quobyte-14dd3d6f-df6c-482d-a106-7999ae11a7d8" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:54 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-40189699-e814-46a6-b598-bbb98ab21c8f tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-14dd3d6f-df6c-482d-a106-7999ae11a7d8" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:54 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-40189699-e814-46a6-b598-bbb98ab21c8f tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "cinder-quobyte-265ddb2e-755e-42c1-be3e-4986f7745b41" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:54 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-40189699-e814-46a6-b598-bbb98ab21c8f tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-265ddb2e-755e-42c1-be3e-4986f7745b41" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:54 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-40189699-e814-46a6-b598-bbb98ab21c8f tempest-GroupSnapshotsTest-519473988 None] Deleting offline snapshot 265ddb2e-755e-42c1-be3e-4986f7745b41 of volume 14dd3d6f-df6c-482d-a106-7999ae11a7d8 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:10:54 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-40189699-e814-46a6-b598-bbb98ab21c8f tempest-GroupSnapshotsTest-519473988 None] snapshot_file for this snap is: volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8.265ddb2e-755e-42c1-be3e-4986f7745b41 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:10:54 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0b2aad-7082-43c6-8656-73fd5191d2ad]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-40189699-e814-46a6-b598-bbb98ab21c8f tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8.265ddb2e-755e-42c1-be3e-4986f7745b41 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:54 devstack sudo[93419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8.265ddb2e-755e-42c1-be3e-4986f7745b41 Jul 08 01:10:54 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:55 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-40189699-e814-46a6-b598-bbb98ab21c8f tempest-GroupSnapshotsTest-519473988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8.265ddb2e-755e-42c1-be3e-4986f7745b41" returned: 0 in 0.995s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:55 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-40189699-e814-46a6-b598-bbb98ab21c8f tempest-GroupSnapshotsTest-519473988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:10:55 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbcc49a-d809-48b0-a3be-d0d6bfbf0d4e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-40189699-e814-46a6-b598-bbb98ab21c8f tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:55 devstack sudo[93430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8 Jul 08 01:10:55 devstack sudo[93430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:56 devstack sudo[93430]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-40189699-e814-46a6-b598-bbb98ab21c8f tempest-GroupSnapshotsTest-519473988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8" returned: 0 in 0.927s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-40189699-e814-46a6-b598-bbb98ab21c8f tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8.265ddb2e-755e-42c1-be3e-4986f7745b41 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:56 devstack sudo[93435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8.265ddb2e-755e-42c1-be3e-4986f7745b41 Jul 08 01:10:56 devstack sudo[93435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:57 devstack sudo[93435]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-40189699-e814-46a6-b598-bbb98ab21c8f tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8.265ddb2e-755e-42c1-be3e-4986f7745b41" returned: 0 in 0.846s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-40189699-e814-46a6-b598-bbb98ab21c8f tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8.265ddb2e-755e-42c1-be3e-4986f7745b41 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:57 devstack sudo[93443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8.265ddb2e-755e-42c1-be3e-4986f7745b41 Jul 08 01:10:57 devstack sudo[93443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:58 devstack sudo[93443]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-40189699-e814-46a6-b598-bbb98ab21c8f tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8.265ddb2e-755e-42c1-be3e-4986f7745b41" returned: 0 in 0.835s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-40189699-e814-46a6-b598-bbb98ab21c8f tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-265ddb2e-755e-42c1-be3e-4986f7745b41" released by "_delete_snapshot" :: held 3.777s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-40189699-e814-46a6-b598-bbb98ab21c8f tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-14dd3d6f-df6c-482d-a106-7999ae11a7d8" released by "delete_snapshot" :: held 3.805s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:58 devstack cinder-volume[87022]: WARNING cinder.quota [None req-40189699-e814-46a6-b598-bbb98ab21c8f tempest-GroupSnapshotsTest-519473988 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1441148809 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1441148809, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:10:58 devstack cinder-volume[87022]: WARNING cinder.quota [None req-40189699-e814-46a6-b598-bbb98ab21c8f tempest-GroupSnapshotsTest-519473988 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1441148809 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1441148809, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:10:58 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-40189699-e814-46a6-b598-bbb98ab21c8f tempest-GroupSnapshotsTest-519473988 None] Created reservations ['4fadd871-96d7-4f29-b61e-98de475af347', '45656123-346a-467a-a411-f4da56b93136', '3c877e03-8012-4c64-8135-0bcf5efb8434', '35b24dff-e3c1-48b8-86bd-c00b2a2b93f2'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:10:58 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-40189699-e814-46a6-b598-bbb98ab21c8f tempest-GroupSnapshotsTest-519473988 None] group_snapshot 0f506bb9-2b3f-46b8-a45c-aac5ac11f28c: deleted successfully Jul 08 01:10:58 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:10:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Flow 'volume_create_manager' (bdb78bef-d54f-474d-9901-db3e87231b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:10:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e7209a0-03bd-4cd7-a1c5-b62e972a00f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e7209a0-03bd-4cd7-a1c5-b62e972a00f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-918636447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf381580-5040-4628-95fa-6727b5bad524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='157306108d124cf49329a4cc793bccee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:10:58Z,use_quota=True,user_id='c3db039932bf477285561c8cb7e18fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f4a8f2-043e-4624-aefe-b81e0e34d68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f4a8f2-043e-4624-aefe-b81e0e34d68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c7ebce8-a8c0-41ab-9934-b21e4a3712bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c7ebce8-a8c0-41ab-9934-b21e4a3712bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf381580-5040-4628-95fa-6727b5bad524', 'volume_name': 'volume-bf381580-5040-4628-95fa-6727b5bad524', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ce24aa-000d-4801-a159-205f85f9c1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ce24aa-000d-4801-a159-205f85f9c1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38bdbe6-9fe5-4dd0-a714-2406d248a4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:58 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Volume bf381580-5040-4628-95fa-6727b5bad524: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf381580-5040-4628-95fa-6727b5bad524', 'volume_size': 1} Jul 08 01:10:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-918636447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf381580-5040-4628-95fa-6727b5bad524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='157306108d124cf49329a4cc793bccee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:10:58Z,use_quota=True,user_id='c3db039932bf477285561c8cb7e18fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:10:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Creating volume bf381580-5040-4628-95fa-6727b5bad524 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:10:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:10:58 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:10:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bf381580-5040-4628-95fa-6727b5bad524 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:58 devstack sudo[93448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bf381580-5040-4628-95fa-6727b5bad524 1073741824 Jul 08 01:10:58 devstack sudo[93448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:59 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b0903c99-b975-42d7-8690-f6cf0faca571 tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "cinder-quobyte-14dd3d6f-df6c-482d-a106-7999ae11a7d8" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:59 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b0903c99-b975-42d7-8690-f6cf0faca571 tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-14dd3d6f-df6c-482d-a106-7999ae11a7d8" acquired by "delete_volume" :: waited 0.060s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:59 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e01f8e8-02f7-426f-b243-df809df0c68e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b0903c99-b975-42d7-8690-f6cf0faca571 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:59 devstack sudo[93475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8 Jul 08 01:10:59 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:59 devstack sudo[93448]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bf381580-5040-4628-95fa-6727b5bad524 1073741824" returned: 0 in 1.404s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bf381580-5040-4628-95fa-6727b5bad524 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:59 devstack sudo[93481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bf381580-5040-4628-95fa-6727b5bad524 Jul 08 01:10:59 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:00 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b0903c99-b975-42d7-8690-f6cf0faca571 tempest-GroupSnapshotsTest-519473988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8" returned: 0 in 1.590s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b0903c99-b975-42d7-8690-f6cf0faca571 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:01 devstack sudo[93502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8 Jul 08 01:11:01 devstack sudo[93502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:01 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bf381580-5040-4628-95fa-6727b5bad524" returned: 0 in 1.238s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] <== create_volume: return (2707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:11:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.709s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:01 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:UPDATE=53,cinder:SELECT=59,cinder:INSERT=14,cinder:DELETE=1 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:11:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38bdbe6-9fe5-4dd0-a714-2406d248a4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf381580-5040-4628-95fa-6727b5bad524', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d82a8350-397d-4beb-b40d-d5b72d277c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:01 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Volume volume-bf381580-5040-4628-95fa-6727b5bad524 (bf381580-5040-4628-95fa-6727b5bad524): created successfully Jul 08 01:11:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d82a8350-397d-4beb-b40d-d5b72d277c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Flow 'volume_create_manager' (bdb78bef-d54f-474d-9901-db3e87231b44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:11:01 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-09196246-0125-48c0-8e24-2ba4a0ed8080 tempest-AttachVolumeNegativeTest-54008946 None] Created volume successfully. Jul 08 01:11:02 devstack sudo[93502]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b0903c99-b975-42d7-8690-f6cf0faca571 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-14dd3d6f-df6c-482d-a106-7999ae11a7d8" returned: 0 in 1.140s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:02 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b0903c99-b975-42d7-8690-f6cf0faca571 tempest-GroupSnapshotsTest-519473988 None] Lock "cinder-quobyte-14dd3d6f-df6c-482d-a106-7999ae11a7d8" released by "delete_volume" :: held 2.874s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:02 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-b0903c99-b975-42d7-8690-f6cf0faca571 tempest-GroupSnapshotsTest-519473988 None] Created reservations ['2451b7d4-4373-4d56-ba0c-ac080115c6dd'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:11:02 devstack cinder-volume[87022]: WARNING cinder.quota [None req-b0903c99-b975-42d7-8690-f6cf0faca571 tempest-GroupSnapshotsTest-519473988 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1441148809 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1441148809, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:11:02 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-b0903c99-b975-42d7-8690-f6cf0faca571 tempest-GroupSnapshotsTest-519473988 None] Created reservations ['d92a0f56-f3ae-4897-b41d-5f92010b8cd6', 'e0dd3400-31b1-4957-b4e6-272175c74ad9', '3a44fcb2-2f0b-4add-8c1e-28f55a687d1a', '5e46253d-bdb4-4e86-b19b-956a7b49f12b'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:11:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b0903c99-b975-42d7-8690-f6cf0faca571 tempest-GroupSnapshotsTest-519473988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b0903c99-b975-42d7-8690-f6cf0faca571 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b0903c99-b975-42d7-8690-f6cf0faca571 tempest-GroupSnapshotsTest-519473988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:11:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b0903c99-b975-42d7-8690-f6cf0faca571 tempest-GroupSnapshotsTest-519473988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:11:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b0903c99-b975-42d7-8690-f6cf0faca571 tempest-GroupSnapshotsTest-519473988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b0903c99-b975-42d7-8690-f6cf0faca571 tempest-GroupSnapshotsTest-519473988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:02 devstack sudo[93572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:11:02 devstack sudo[93572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:04 devstack sudo[93572]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b0903c99-b975-42d7-8690-f6cf0faca571 tempest-GroupSnapshotsTest-519473988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.389s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:04 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-b0903c99-b975-42d7-8690-f6cf0faca571 tempest-GroupSnapshotsTest-519473988 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:11:04 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-b0903c99-b975-42d7-8690-f6cf0faca571 tempest-GroupSnapshotsTest-519473988 None] Delete group completed successfully. Jul 08 01:11:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-da1bdf20-3d5a-41f4-a1f3-0573501d9223 req-b36c1b80-0097-43fe-a7af-72c5d62363c5 tempest-AttachVolumeNegativeTest-54008946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-da1bdf20-3d5a-41f4-a1f3-0573501d9223 req-b36c1b80-0097-43fe-a7af-72c5d62363c5 tempest-AttachVolumeNegativeTest-54008946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:05 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1adbed-1657-4fc6-b054-faf40f5914a7]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-da1bdf20-3d5a-41f4-a1f3-0573501d9223 req-b36c1b80-0097-43fe-a7af-72c5d62363c5 tempest-AttachVolumeNegativeTest-54008946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bf381580-5040-4628-95fa-6727b5bad524 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:05 devstack sudo[93614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bf381580-5040-4628-95fa-6727b5bad524 Jul 08 01:11:05 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:06 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-da1bdf20-3d5a-41f4-a1f3-0573501d9223 req-b36c1b80-0097-43fe-a7af-72c5d62363c5 tempest-AttachVolumeNegativeTest-54008946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bf381580-5040-4628-95fa-6727b5bad524" returned: 0 in 1.129s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-da1bdf20-3d5a-41f4-a1f3-0573501d9223 req-b36c1b80-0097-43fe-a7af-72c5d62363c5 tempest-AttachVolumeNegativeTest-54008946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.161s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-da1bdf20-3d5a-41f4-a1f3-0573501d9223 req-b36c1b80-0097-43fe-a7af-72c5d62363c5 tempest-AttachVolumeNegativeTest-54008946 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d', 'name': 'volume-bf381580-5040-4628-95fa-6727b5bad524', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '35ecb16b-7d51-4a1d-8355-e6c9758fbe36', 'enforce_multipath': True} {{(pid=87022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:11:06 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-da1bdf20-3d5a-41f4-a1f3-0573501d9223 req-b36c1b80-0097-43fe-a7af-72c5d62363c5 tempest-AttachVolumeNegativeTest-54008946 None] attachment_update completed successfully. Jul 08 01:11:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-869c663e-43c1-4afa-b532-3ca799eadde8 tempest-ServerRescueNegativeTestJSON-1690878936 None] Acquiring lock "cinder-74ddfe47-afb2-4227-b869-1cdd135bd0ed-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-869c663e-43c1-4afa-b532-3ca799eadde8 tempest-ServerRescueNegativeTestJSON-1690878936 None] Lock "cinder-74ddfe47-afb2-4227-b869-1cdd135bd0ed-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-869c663e-43c1-4afa-b532-3ca799eadde8 tempest-ServerRescueNegativeTestJSON-1690878936 None] Acquiring lock "cinder-quobyte-74ddfe47-afb2-4227-b869-1cdd135bd0ed" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-869c663e-43c1-4afa-b532-3ca799eadde8 tempest-ServerRescueNegativeTestJSON-1690878936 None] Lock "cinder-quobyte-74ddfe47-afb2-4227-b869-1cdd135bd0ed" acquired by "delete_volume" :: waited 0.036s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:08 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefacd00-6719-4726-98bb-7f3e39195845]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-869c663e-43c1-4afa-b532-3ca799eadde8 tempest-ServerRescueNegativeTestJSON-1690878936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-74ddfe47-afb2-4227-b869-1cdd135bd0ed {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:08 devstack sudo[94020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-74ddfe47-afb2-4227-b869-1cdd135bd0ed Jul 08 01:11:08 devstack sudo[94020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:09 devstack sudo[94020]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-869c663e-43c1-4afa-b532-3ca799eadde8 tempest-ServerRescueNegativeTestJSON-1690878936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-74ddfe47-afb2-4227-b869-1cdd135bd0ed" returned: 0 in 1.041s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-869c663e-43c1-4afa-b532-3ca799eadde8 tempest-ServerRescueNegativeTestJSON-1690878936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-74ddfe47-afb2-4227-b869-1cdd135bd0ed {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:09 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-74ddfe47-afb2-4227-b869-1cdd135bd0ed Jul 08 01:11:09 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:10 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-869c663e-43c1-4afa-b532-3ca799eadde8 tempest-ServerRescueNegativeTestJSON-1690878936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-74ddfe47-afb2-4227-b869-1cdd135bd0ed" returned: 0 in 0.803s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:10 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-869c663e-43c1-4afa-b532-3ca799eadde8 tempest-ServerRescueNegativeTestJSON-1690878936 None] Lock "cinder-quobyte-74ddfe47-afb2-4227-b869-1cdd135bd0ed" released by "delete_volume" :: held 1.931s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:10 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-869c663e-43c1-4afa-b532-3ca799eadde8 tempest-ServerRescueNegativeTestJSON-1690878936 None] Created reservations ['7ee9f179-8617-47dd-ae89-8fa7b8f860fc', '996c6979-a75d-446f-ac21-1dbff6321ffb', '2999330c-7fa5-46c0-b048-3d52054da33f', 'abc33558-1d93-4359-9f66-c48f06dbb456'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:11:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-869c663e-43c1-4afa-b532-3ca799eadde8 tempest-ServerRescueNegativeTestJSON-1690878936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-869c663e-43c1-4afa-b532-3ca799eadde8 tempest-ServerRescueNegativeTestJSON-1690878936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-869c663e-43c1-4afa-b532-3ca799eadde8 tempest-ServerRescueNegativeTestJSON-1690878936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:11:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-869c663e-43c1-4afa-b532-3ca799eadde8 tempest-ServerRescueNegativeTestJSON-1690878936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:11:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-869c663e-43c1-4afa-b532-3ca799eadde8 tempest-ServerRescueNegativeTestJSON-1690878936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-869c663e-43c1-4afa-b532-3ca799eadde8 tempest-ServerRescueNegativeTestJSON-1690878936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:10 devstack sudo[94028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:11:10 devstack sudo[94028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-869c663e-43c1-4afa-b532-3ca799eadde8 tempest-ServerRescueNegativeTestJSON-1690878936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.935s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:11 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-869c663e-43c1-4afa-b532-3ca799eadde8 tempest-ServerRescueNegativeTestJSON-1690878936 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:11:11 devstack sudo[94028]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:11 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-869c663e-43c1-4afa-b532-3ca799eadde8 tempest-ServerRescueNegativeTestJSON-1690878936 None] Deleted volume successfully. Jul 08 01:11:11 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-869c663e-43c1-4afa-b532-3ca799eadde8 tempest-ServerRescueNegativeTestJSON-1690878936 None] Lock "cinder-74ddfe47-afb2-4227-b869-1cdd135bd0ed-delete_volume" released by "delete_volume" :: held 3.262s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:12 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-6fa2cdcf-fc53-4450-b1bc-caec925400dc tempest-GroupsTest-130131857 None] Group tempest-Group1-1359245058: creating Jul 08 01:11:12 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-6fa2cdcf-fc53-4450-b1bc-caec925400dc tempest-GroupsTest-130131857 None] Group tempest-Group1-1359245058: created successfully Jul 08 01:11:12 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-6fa2cdcf-fc53-4450-b1bc-caec925400dc tempest-GroupsTest-130131857 None] Create group completed successfully. Jul 08 01:11:13 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-9b7fcb46-a838-4c1a-b1c3-ea587deecf79 tempest-GroupsTest-130131857 None] Group tempest-Group2-1864707555: creating Jul 08 01:11:13 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-9b7fcb46-a838-4c1a-b1c3-ea587deecf79 tempest-GroupsTest-130131857 None] Group tempest-Group2-1864707555: created successfully Jul 08 01:11:13 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-9b7fcb46-a838-4c1a-b1c3-ea587deecf79 tempest-GroupsTest-130131857 None] Create group completed successfully. Jul 08 01:11:14 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-8fc66383-6a18-4af1-9155-42441948739a req-a9669a9a-3cfe-4aee-9888-3159a5f1a719 tempest-AttachVolumeNegativeTest-54008946 None] Terminate volume connection completed successfully. Jul 08 01:11:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-8fc66383-6a18-4af1-9155-42441948739a req-a9669a9a-3cfe-4aee-9888-3159a5f1a719 tempest-AttachVolumeNegativeTest-54008946 None] Deleting attachment 35ecb16b-7d51-4a1d-8355-e6c9758fbe36. {{(pid=87022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:11:15 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:11:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Flow 'volume_create_manager' (58aa4cee-e184-46ef-8117-830398c0f324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:11:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b095d5b-d4b0-43c2-80e7-f8c15f1c7c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b095d5b-d4b0-43c2-80e7-f8c15f1c7c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-255629670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=794f0ef7-75eb-4914-b1d6-2c255507a069,host='devstack@QuobyteHD#QuobyteHD',id=bb76030c-bc84-4246-bfc5-a79084e8e74c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07445f90fdc647be9922f4ecba2cdd05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:11:16Z,use_quota=True,user_id='2b7500b6dffa44c1a9022d0aadc623a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5702632e-6e0f-4186-98bb-53cd44aba0fb),volume_type_id=5702632e-6e0f-4186-98bb-53cd44aba0fb)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60c6c09f-c3f5-46d8-9bac-bac5a7480b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60c6c09f-c3f5-46d8-9bac-bac5a7480b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (668bc649-17a7-46f2-8f1a-f89f4bfa77e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (668bc649-17a7-46f2-8f1a-f89f4bfa77e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb76030c-bc84-4246-bfc5-a79084e8e74c', 'volume_name': 'volume-bb76030c-bc84-4246-bfc5-a79084e8e74c', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8265279a-85e1-4d85-abaa-8476fa72d0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8265279a-85e1-4d85-abaa-8476fa72d0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7e6dd7-efb6-4e0e-94c1-cec9c5bf1174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:15 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Volume bb76030c-bc84-4246-bfc5-a79084e8e74c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb76030c-bc84-4246-bfc5-a79084e8e74c', 'volume_size': 1} Jul 08 01:11:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:15 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=794f0ef7-75eb-4914-b1d6-2c255507a069,created_at=2026-07-07T23:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-255629670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=794f0ef7-75eb-4914-b1d6-2c255507a069,host='devstack@QuobyteHD#QuobyteHD',id=bb76030c-bc84-4246-bfc5-a79084e8e74c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07445f90fdc647be9922f4ecba2cdd05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:11:16Z,use_quota=True,user_id='2b7500b6dffa44c1a9022d0aadc623a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5702632e-6e0f-4186-98bb-53cd44aba0fb),volume_type_id=5702632e-6e0f-4186-98bb-53cd44aba0fb)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:11:15 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Creating volume bb76030c-bc84-4246-bfc5-a79084e8e74c {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:11:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:15 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:11:15 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:11:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:15 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:11:15 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:11:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bb76030c-bc84-4246-bfc5-a79084e8e74c 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:16 devstack sudo[94115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bb76030c-bc84-4246-bfc5-a79084e8e74c 1073741824 Jul 08 01:11:16 devstack sudo[94115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:17 devstack sudo[94115]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bb76030c-bc84-4246-bfc5-a79084e8e74c 1073741824" returned: 0 in 1.450s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bb76030c-bc84-4246-bfc5-a79084e8e74c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:17 devstack sudo[94125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bb76030c-bc84-4246-bfc5-a79084e8e74c Jul 08 01:11:17 devstack sudo[94125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:18 devstack sudo[94125]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bb76030c-bc84-4246-bfc5-a79084e8e74c" returned: 0 in 0.722s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] <== create_volume: return (2231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:11:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.235s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7e6dd7-efb6-4e0e-94c1-cec9c5bf1174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb76030c-bc84-4246-bfc5-a79084e8e74c', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3419f1f7-b917-42ca-a967-6c3f035c21a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:18 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Volume volume-bb76030c-bc84-4246-bfc5-a79084e8e74c (bb76030c-bc84-4246-bfc5-a79084e8e74c): created successfully Jul 08 01:11:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3419f1f7-b917-42ca-a967-6c3f035c21a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Flow 'volume_create_manager' (58aa4cee-e184-46ef-8117-830398c0f324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:11:18 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-93f9b384-3ab7-48c1-88ce-7be8d977a96e tempest-GroupsTest-130131857 None] Created volume successfully. Jul 08 01:11:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-14a56cf8-64df-4341-829b-a5bd18db861d tempest-GroupsTest-130131857 None] Acquiring lock "cinder-quobyte-bb76030c-bc84-4246-bfc5-a79084e8e74c" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-14a56cf8-64df-4341-829b-a5bd18db861d tempest-GroupsTest-130131857 None] Lock "cinder-quobyte-bb76030c-bc84-4246-bfc5-a79084e8e74c" acquired by "delete_volume" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:20 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1c9dde-5c88-4bf6-b801-56c4ce156895]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-14a56cf8-64df-4341-829b-a5bd18db861d tempest-GroupsTest-130131857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bb76030c-bc84-4246-bfc5-a79084e8e74c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:20 devstack sudo[94156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bb76030c-bc84-4246-bfc5-a79084e8e74c Jul 08 01:11:20 devstack sudo[94156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:21 devstack sudo[94156]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-14a56cf8-64df-4341-829b-a5bd18db861d tempest-GroupsTest-130131857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bb76030c-bc84-4246-bfc5-a79084e8e74c" returned: 0 in 1.008s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-14a56cf8-64df-4341-829b-a5bd18db861d tempest-GroupsTest-130131857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bb76030c-bc84-4246-bfc5-a79084e8e74c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:21 devstack sudo[94177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bb76030c-bc84-4246-bfc5-a79084e8e74c Jul 08 01:11:21 devstack sudo[94177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:22 devstack sudo[94177]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-14a56cf8-64df-4341-829b-a5bd18db861d tempest-GroupsTest-130131857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bb76030c-bc84-4246-bfc5-a79084e8e74c" returned: 0 in 0.896s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-14a56cf8-64df-4341-829b-a5bd18db861d tempest-GroupsTest-130131857 None] Lock "cinder-quobyte-bb76030c-bc84-4246-bfc5-a79084e8e74c" released by "delete_volume" :: held 1.984s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:22 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-14a56cf8-64df-4341-829b-a5bd18db861d tempest-GroupsTest-130131857 None] Created reservations ['fef2b6b0-be77-43c0-bd71-f534d2c43271'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:11:22 devstack cinder-volume[87022]: WARNING cinder.quota [None req-14a56cf8-64df-4341-829b-a5bd18db861d tempest-GroupsTest-130131857 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1102900436 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1102900436, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:11:22 devstack cinder-volume[87022]: WARNING cinder.quota [None req-14a56cf8-64df-4341-829b-a5bd18db861d tempest-GroupsTest-130131857 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1102900436 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1102900436, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:11:22 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-14a56cf8-64df-4341-829b-a5bd18db861d tempest-GroupsTest-130131857 None] Created reservations ['8018f553-2b5f-4c01-9bbe-b469da24a58e', '8a0e4b68-e23e-441d-9e64-a00a0d6a70e5', 'f95a639d-6303-4f87-a56b-9392c775a538', 'c3b2da07-66a6-4500-bcb8-c86f44c41075'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:11:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-14a56cf8-64df-4341-829b-a5bd18db861d tempest-GroupsTest-130131857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-14a56cf8-64df-4341-829b-a5bd18db861d tempest-GroupsTest-130131857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:22 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-14a56cf8-64df-4341-829b-a5bd18db861d tempest-GroupsTest-130131857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:11:22 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-14a56cf8-64df-4341-829b-a5bd18db861d tempest-GroupsTest-130131857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:11:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-14a56cf8-64df-4341-829b-a5bd18db861d tempest-GroupsTest-130131857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-14a56cf8-64df-4341-829b-a5bd18db861d tempest-GroupsTest-130131857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:22 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:11:22 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:22 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-f6497993-9d3b-44fe-8f7e-b347f231b01f tempest-GroupsTest-130131857 None] Created reservations ['9fcafe02-c8a5-460f-8f5a-f88cd25512e3'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:11:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f6497993-9d3b-44fe-8f7e-b347f231b01f tempest-GroupsTest-130131857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f6497993-9d3b-44fe-8f7e-b347f231b01f tempest-GroupsTest-130131857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f6497993-9d3b-44fe-8f7e-b347f231b01f tempest-GroupsTest-130131857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:11:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f6497993-9d3b-44fe-8f7e-b347f231b01f tempest-GroupsTest-130131857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:11:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f6497993-9d3b-44fe-8f7e-b347f231b01f tempest-GroupsTest-130131857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f6497993-9d3b-44fe-8f7e-b347f231b01f tempest-GroupsTest-130131857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:23 devstack sudo[94184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:11:23 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:23 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-14a56cf8-64df-4341-829b-a5bd18db861d tempest-GroupsTest-130131857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.812s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:23 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-14a56cf8-64df-4341-829b-a5bd18db861d tempest-GroupsTest-130131857 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:11:23 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-14a56cf8-64df-4341-829b-a5bd18db861d tempest-GroupsTest-130131857 None] Delete group completed successfully. Jul 08 01:11:23 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f6497993-9d3b-44fe-8f7e-b347f231b01f tempest-GroupsTest-130131857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.893s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:23 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-f6497993-9d3b-44fe-8f7e-b347f231b01f tempest-GroupsTest-130131857 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:11:23 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-f6497993-9d3b-44fe-8f7e-b347f231b01f tempest-GroupsTest-130131857 None] Delete group completed successfully. Jul 08 01:11:24 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-fd073791-d36e-4778-b91e-41959a151638 tempest-GroupsTest-130131857 None] Group tempest-GroupsTest-Group-65361306: creating Jul 08 01:11:24 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-fd073791-d36e-4778-b91e-41959a151638 tempest-GroupsTest-130131857 None] Group tempest-GroupsTest-Group-65361306: created successfully Jul 08 01:11:24 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-fd073791-d36e-4778-b91e-41959a151638 tempest-GroupsTest-130131857 None] Create group completed successfully. Jul 08 01:11:26 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:11:26 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Flow 'volume_create_manager' (9543433f-9d0f-4861-bd80-39e053d26d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:11:26 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c2bc56-d58b-4494-9c44-8dea267d3ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:26 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c2bc56-d58b-4494-9c44-8dea267d3ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-584122510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=28c12c8a-645c-4881-9b50-1fea7e32cb94,host='devstack@QuobyteHD#QuobyteHD',id=b4757e0a-77c1-43dd-a7d8-2595d8db6831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07445f90fdc647be9922f4ecba2cdd05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:11:26Z,use_quota=True,user_id='2b7500b6dffa44c1a9022d0aadc623a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8444a56-54f1-4983-b51f-7ab448ad13d9),volume_type_id=c8444a56-54f1-4983-b51f-7ab448ad13d9)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:26 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e947884-9992-4119-91a0-f552a705fa9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:26 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e947884-9992-4119-91a0-f552a705fa9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:26 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76be493b-2652-4145-9af1-2a55415ef97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:26 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76be493b-2652-4145-9af1-2a55415ef97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4757e0a-77c1-43dd-a7d8-2595d8db6831', 'volume_name': 'volume-b4757e0a-77c1-43dd-a7d8-2595d8db6831', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:26 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced722ab-5dc8-436e-b311-319947637157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:26 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced722ab-5dc8-436e-b311-319947637157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:26 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a42d95-7912-4e3f-868e-102c504b6a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:26 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Volume b4757e0a-77c1-43dd-a7d8-2595d8db6831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4757e0a-77c1-43dd-a7d8-2595d8db6831', 'volume_size': 1} Jul 08 01:11:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:26 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=28c12c8a-645c-4881-9b50-1fea7e32cb94,created_at=2026-07-07T23:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-584122510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=28c12c8a-645c-4881-9b50-1fea7e32cb94,host='devstack@QuobyteHD#QuobyteHD',id=b4757e0a-77c1-43dd-a7d8-2595d8db6831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07445f90fdc647be9922f4ecba2cdd05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:11:26Z,use_quota=True,user_id='2b7500b6dffa44c1a9022d0aadc623a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8444a56-54f1-4983-b51f-7ab448ad13d9),volume_type_id=c8444a56-54f1-4983-b51f-7ab448ad13d9)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:11:26 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Creating volume b4757e0a-77c1-43dd-a7d8-2595d8db6831 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:11:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:26 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:11:26 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:11:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:26 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:11:26 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:11:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b4757e0a-77c1-43dd-a7d8-2595d8db6831 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:26 devstack sudo[94189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b4757e0a-77c1-43dd-a7d8-2595d8db6831 1073741824 Jul 08 01:11:26 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:27 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b4757e0a-77c1-43dd-a7d8-2595d8db6831 1073741824" returned: 0 in 1.188s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:27 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=81,cinder:UPDATE=99,cinder:INSERT=19,cinder:DELETE=2 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:11:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b4757e0a-77c1-43dd-a7d8-2595d8db6831 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:27 devstack sudo[94200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b4757e0a-77c1-43dd-a7d8-2595d8db6831 Jul 08 01:11:27 devstack sudo[94200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:28 devstack sudo[94200]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b4757e0a-77c1-43dd-a7d8-2595d8db6831" returned: 0 in 1.008s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:28 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] <== create_volume: return (2265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:11:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.270s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:28 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a42d95-7912-4e3f-868e-102c504b6a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4757e0a-77c1-43dd-a7d8-2595d8db6831', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:28 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a082c0-8ae9-43c7-84e3-15cf34f70068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:28 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Volume volume-b4757e0a-77c1-43dd-a7d8-2595d8db6831 (b4757e0a-77c1-43dd-a7d8-2595d8db6831): created successfully Jul 08 01:11:28 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a082c0-8ae9-43c7-84e3-15cf34f70068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:28 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Flow 'volume_create_manager' (9543433f-9d0f-4861-bd80-39e053d26d9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:11:28 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-62490452-7555-44fc-96bb-adc9b3115dce tempest-GroupsTest-130131857 None] Created volume successfully. Jul 08 01:11:31 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:11:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Flow 'volume_create_manager' (9369d560-46fc-4bcd-b7d7-3abe582da098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:11:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09a1b423-6639-408f-8ed6-fc03c3e6412d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09a1b423-6639-408f-8ed6-fc03c3e6412d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-635928086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=28c12c8a-645c-4881-9b50-1fea7e32cb94,host='devstack@QuobyteHD#QuobyteHD',id=58219d03-6854-475a-8519-8cfcbe4df9a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07445f90fdc647be9922f4ecba2cdd05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:11:31Z,use_quota=True,user_id='2b7500b6dffa44c1a9022d0aadc623a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8444a56-54f1-4983-b51f-7ab448ad13d9),volume_type_id=c8444a56-54f1-4983-b51f-7ab448ad13d9)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77795597-623e-4a65-b248-b77bc3f7b332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77795597-623e-4a65-b248-b77bc3f7b332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf103a12-cf7a-4b23-9ca9-738b3e5dfade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf103a12-cf7a-4b23-9ca9-738b3e5dfade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58219d03-6854-475a-8519-8cfcbe4df9a2', 'volume_name': 'volume-58219d03-6854-475a-8519-8cfcbe4df9a2', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (903ea49b-6717-47b5-8f95-133f12da3e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (903ea49b-6717-47b5-8f95-133f12da3e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090d8685-80e1-4c5d-9e32-a5c6acaade42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:31 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Volume 58219d03-6854-475a-8519-8cfcbe4df9a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58219d03-6854-475a-8519-8cfcbe4df9a2', 'volume_size': 1} Jul 08 01:11:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=28c12c8a-645c-4881-9b50-1fea7e32cb94,created_at=2026-07-07T23:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-635928086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=28c12c8a-645c-4881-9b50-1fea7e32cb94,host='devstack@QuobyteHD#QuobyteHD',id=58219d03-6854-475a-8519-8cfcbe4df9a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07445f90fdc647be9922f4ecba2cdd05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:11:31Z,use_quota=True,user_id='2b7500b6dffa44c1a9022d0aadc623a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8444a56-54f1-4983-b51f-7ab448ad13d9),volume_type_id=c8444a56-54f1-4983-b51f-7ab448ad13d9)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:11:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Creating volume 58219d03-6854-475a-8519-8cfcbe4df9a2 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:11:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:11:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:11:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:11:31 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:11:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-58219d03-6854-475a-8519-8cfcbe4df9a2 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:31 devstack sudo[94208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-58219d03-6854-475a-8519-8cfcbe4df9a2 1073741824 Jul 08 01:11:31 devstack sudo[94208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:32 devstack sudo[94208]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-58219d03-6854-475a-8519-8cfcbe4df9a2 1073741824" returned: 0 in 1.261s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-58219d03-6854-475a-8519-8cfcbe4df9a2 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:32 devstack sudo[94215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-58219d03-6854-475a-8519-8cfcbe4df9a2 Jul 08 01:11:32 devstack sudo[94215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:33 devstack sudo[94215]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-58219d03-6854-475a-8519-8cfcbe4df9a2" returned: 0 in 1.000s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:33 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] <== create_volume: return (2362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:11:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.365s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090d8685-80e1-4c5d-9e32-a5c6acaade42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58219d03-6854-475a-8519-8cfcbe4df9a2', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (213c240b-8773-4f9e-b518-cf513619e955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:33 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Volume volume-58219d03-6854-475a-8519-8cfcbe4df9a2 (58219d03-6854-475a-8519-8cfcbe4df9a2): created successfully Jul 08 01:11:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (213c240b-8773-4f9e-b518-cf513619e955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Flow 'volume_create_manager' (9369d560-46fc-4bcd-b7d7-3abe582da098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:11:33 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-b663f0e2-961f-4680-b634-017f36a9ff4e tempest-GroupsTest-130131857 None] Created volume successfully. Jul 08 01:11:34 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-2e5b5853-50b5-433c-a4c8-db362dabd3dc tempest-GroupsTest-130131857 None] Update group completed successfully. Jul 08 01:11:35 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-edd6a716-9e34-4ba3-9d37-bec8815387a5 tempest-GroupsTest-130131857 None] Update group completed successfully. Jul 08 01:11:36 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:11:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Flow 'volume_create_manager' (da49f3b9-fb02-44a4-8a28-d93b02c1d709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:11:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f15a98-8f5e-4cea-8a4e-7376bc7e27ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f15a98-8f5e-4cea-8a4e-7376bc7e27ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1692339244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e366b68-ad87-47dc-9a42-76f8ada76a42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='771e81f185774b31a0addd4e0c9bd6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:11:37Z,use_quota=True,user_id='4008b1202cff43a1b36f344fd31665a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50fd228d-7214-4524-93e0-fb9e16aaadb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50fd228d-7214-4524-93e0-fb9e16aaadb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f71836-19fb-4b61-82b8-84d05c0054c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f71836-19fb-4b61-82b8-84d05c0054c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e366b68-ad87-47dc-9a42-76f8ada76a42', 'volume_name': 'volume-9e366b68-ad87-47dc-9a42-76f8ada76a42', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef1d8fb-d91e-4f28-987b-9e8d7c75c003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef1d8fb-d91e-4f28-987b-9e8d7c75c003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f376f6-c738-47c3-8abc-2a988ad713e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:36 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Volume 9e366b68-ad87-47dc-9a42-76f8ada76a42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e366b68-ad87-47dc-9a42-76f8ada76a42', 'volume_size': 1} Jul 08 01:11:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1692339244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e366b68-ad87-47dc-9a42-76f8ada76a42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='771e81f185774b31a0addd4e0c9bd6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:11:37Z,use_quota=True,user_id='4008b1202cff43a1b36f344fd31665a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:11:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Creating volume 9e366b68-ad87-47dc-9a42-76f8ada76a42 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:11:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:11:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:11:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:11:36 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:11:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:36 devstack sudo[94236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42 1073741824 Jul 08 01:11:36 devstack sudo[94236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:37 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-044a3f6b-489d-414f-8e3b-92d2fc7cbb4b tempest-GroupsTest-130131857 None] Acquiring lock "cinder-quobyte-58219d03-6854-475a-8519-8cfcbe4df9a2" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:37 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-044a3f6b-489d-414f-8e3b-92d2fc7cbb4b tempest-GroupsTest-130131857 None] Lock "cinder-quobyte-58219d03-6854-475a-8519-8cfcbe4df9a2" acquired by "delete_volume" :: waited 0.041s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:37 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[90efd201-767b-4b0c-aefd-7b0a2529391d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-044a3f6b-489d-414f-8e3b-92d2fc7cbb4b tempest-GroupsTest-130131857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-58219d03-6854-475a-8519-8cfcbe4df9a2 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:37 devstack sudo[94243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-58219d03-6854-475a-8519-8cfcbe4df9a2 Jul 08 01:11:37 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:38 devstack sudo[94236]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42 1073741824" returned: 0 in 1.282s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:38 devstack sudo[94261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42 Jul 08 01:11:38 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:39 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-044a3f6b-489d-414f-8e3b-92d2fc7cbb4b tempest-GroupsTest-130131857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-58219d03-6854-475a-8519-8cfcbe4df9a2" returned: 0 in 1.351s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-044a3f6b-489d-414f-8e3b-92d2fc7cbb4b tempest-GroupsTest-130131857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-58219d03-6854-475a-8519-8cfcbe4df9a2 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:39 devstack sudo[94299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-58219d03-6854-475a-8519-8cfcbe4df9a2 Jul 08 01:11:39 devstack sudo[94299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:39 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42" returned: 0 in 1.239s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:39 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] <== create_volume: return (2639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:11:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.642s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f376f6-c738-47c3-8abc-2a988ad713e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e366b68-ad87-47dc-9a42-76f8ada76a42', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cdc6ac4-6b64-415b-9bbd-18b125ac7ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:39 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Volume volume-9e366b68-ad87-47dc-9a42-76f8ada76a42 (9e366b68-ad87-47dc-9a42-76f8ada76a42): created successfully Jul 08 01:11:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cdc6ac4-6b64-415b-9bbd-18b125ac7ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Flow 'volume_create_manager' (da49f3b9-fb02-44a4-8a28-d93b02c1d709) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:11:39 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-87e3d810-061f-4049-8e07-8d697a27f1b2 req-3dadddc8-cf64-4741-8bba-133c6052cda2 tempest-VolumesSnapshotsTestJSON-49290421 None] Created volume successfully. Jul 08 01:11:39 devstack sudo[94299]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-044a3f6b-489d-414f-8e3b-92d2fc7cbb4b tempest-GroupsTest-130131857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-58219d03-6854-475a-8519-8cfcbe4df9a2" returned: 0 in 0.922s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:39 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-044a3f6b-489d-414f-8e3b-92d2fc7cbb4b tempest-GroupsTest-130131857 None] Lock "cinder-quobyte-58219d03-6854-475a-8519-8cfcbe4df9a2" released by "delete_volume" :: held 2.347s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:39 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-044a3f6b-489d-414f-8e3b-92d2fc7cbb4b tempest-GroupsTest-130131857 None] Acquiring lock "cinder-quobyte-b4757e0a-77c1-43dd-a7d8-2595d8db6831" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:40 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-044a3f6b-489d-414f-8e3b-92d2fc7cbb4b tempest-GroupsTest-130131857 None] Lock "cinder-quobyte-b4757e0a-77c1-43dd-a7d8-2595d8db6831" acquired by "delete_volume" :: waited 0.023s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:40 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae211310-173c-4707-bb8e-5e3683213ff9]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-044a3f6b-489d-414f-8e3b-92d2fc7cbb4b tempest-GroupsTest-130131857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b4757e0a-77c1-43dd-a7d8-2595d8db6831 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:40 devstack sudo[94319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b4757e0a-77c1-43dd-a7d8-2595d8db6831 Jul 08 01:11:40 devstack sudo[94319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-f37ca93e-b0ea-493e-9db7-49b473fd196e req-b63a414c-6a89-4b55-852c-2f92f2d3eb10 tempest-VolumesSnapshotsTestJSON-49290421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-f37ca93e-b0ea-493e-9db7-49b473fd196e req-b63a414c-6a89-4b55-852c-2f92f2d3eb10 tempest-VolumesSnapshotsTestJSON-49290421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:40 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [req-f37ca93e-b0ea-493e-9db7-49b473fd196e req-b63a414c-6a89-4b55-852c-2f92f2d3eb10 tempest-VolumesSnapshotsTestJSON-49290421 None] Creating offline snapshot 4c03c84f-2185-4417-870b-3595b0433211 of volume 9e366b68-ad87-47dc-9a42-76f8ada76a42 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:11:40 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9eb5be-fa57-4788-857c-2881e73a1946]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-f37ca93e-b0ea-493e-9db7-49b473fd196e req-b63a414c-6a89-4b55-852c-2f92f2d3eb10 tempest-VolumesSnapshotsTestJSON-49290421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:40 devstack sudo[94340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42 Jul 08 01:11:40 devstack sudo[94340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:41 devstack sudo[94319]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-044a3f6b-489d-414f-8e3b-92d2fc7cbb4b tempest-GroupsTest-130131857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b4757e0a-77c1-43dd-a7d8-2595d8db6831" returned: 0 in 1.303s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-044a3f6b-489d-414f-8e3b-92d2fc7cbb4b tempest-GroupsTest-130131857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b4757e0a-77c1-43dd-a7d8-2595d8db6831 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:41 devstack sudo[94345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b4757e0a-77c1-43dd-a7d8-2595d8db6831 Jul 08 01:11:41 devstack sudo[94345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:41 devstack sudo[94340]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-f37ca93e-b0ea-493e-9db7-49b473fd196e req-b63a414c-6a89-4b55-852c-2f92f2d3eb10 tempest-VolumesSnapshotsTestJSON-49290421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42" returned: 0 in 1.144s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-f37ca93e-b0ea-493e-9db7-49b473fd196e req-b63a414c-6a89-4b55-852c-2f92f2d3eb10 tempest-VolumesSnapshotsTestJSON-49290421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42.4c03c84f-2185-4417-870b-3595b0433211 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:41 devstack sudo[94352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42.4c03c84f-2185-4417-870b-3595b0433211 1G Jul 08 01:11:41 devstack sudo[94352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:42 devstack sudo[94345]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-044a3f6b-489d-414f-8e3b-92d2fc7cbb4b tempest-GroupsTest-130131857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b4757e0a-77c1-43dd-a7d8-2595d8db6831" returned: 0 in 0.840s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-044a3f6b-489d-414f-8e3b-92d2fc7cbb4b tempest-GroupsTest-130131857 None] Lock "cinder-quobyte-b4757e0a-77c1-43dd-a7d8-2595d8db6831" released by "delete_volume" :: held 2.203s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:42 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-044a3f6b-489d-414f-8e3b-92d2fc7cbb4b tempest-GroupsTest-130131857 None] Created reservations ['9bc5d7ba-e79f-4233-b656-a443314bc0e8'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:11:42 devstack cinder-volume[87022]: WARNING cinder.quota [None req-044a3f6b-489d-414f-8e3b-92d2fc7cbb4b tempest-GroupsTest-130131857 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-705803357 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-705803357, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:11:42 devstack cinder-volume[87022]: WARNING cinder.quota [None req-044a3f6b-489d-414f-8e3b-92d2fc7cbb4b tempest-GroupsTest-130131857 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-705803357 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-705803357, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:11:42 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-044a3f6b-489d-414f-8e3b-92d2fc7cbb4b tempest-GroupsTest-130131857 None] Created reservations ['9c4d8b26-144c-43aa-a671-553d31b42298', '370ae827-712c-49a6-94dc-543682dd9e94', '862f19e9-01dd-4e4e-bd37-f5b9a92dbc6a', 'f6e265d4-8e5f-4472-88dc-9a882f7de994'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:11:42 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-044a3f6b-489d-414f-8e3b-92d2fc7cbb4b tempest-GroupsTest-130131857 None] Created reservations ['61920582-068c-4374-9d99-4e5fdce5d2ee', 'bb36d2ea-f26a-43fe-8c0e-621c8ec4e9d9', '8e2643a2-9735-419c-b483-0036677e7f22', '59f8df71-87e2-490c-925c-d76d230bedbc'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:11:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-044a3f6b-489d-414f-8e3b-92d2fc7cbb4b tempest-GroupsTest-130131857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-044a3f6b-489d-414f-8e3b-92d2fc7cbb4b tempest-GroupsTest-130131857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:43 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-044a3f6b-489d-414f-8e3b-92d2fc7cbb4b tempest-GroupsTest-130131857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:11:43 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-044a3f6b-489d-414f-8e3b-92d2fc7cbb4b tempest-GroupsTest-130131857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:11:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-044a3f6b-489d-414f-8e3b-92d2fc7cbb4b tempest-GroupsTest-130131857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-044a3f6b-489d-414f-8e3b-92d2fc7cbb4b tempest-GroupsTest-130131857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:43 devstack sudo[94387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:11:43 devstack sudo[94387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:43 devstack sudo[94352]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-f37ca93e-b0ea-493e-9db7-49b473fd196e req-b63a414c-6a89-4b55-852c-2f92f2d3eb10 tempest-VolumesSnapshotsTestJSON-49290421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42.4c03c84f-2185-4417-870b-3595b0433211 1G" returned: 0 in 2.229s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-f37ca93e-b0ea-493e-9db7-49b473fd196e req-b63a414c-6a89-4b55-852c-2f92f2d3eb10 tempest-VolumesSnapshotsTestJSON-49290421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e366b68-ad87-47dc-9a42-76f8ada76a42 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42.4c03c84f-2185-4417-870b-3595b0433211 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:44 devstack sudo[94391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e366b68-ad87-47dc-9a42-76f8ada76a42 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42.4c03c84f-2185-4417-870b-3595b0433211 Jul 08 01:11:44 devstack sudo[94391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:45 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:11:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:11:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:11:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:45 devstack sudo[94421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:11:45 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:45 devstack sudo[94387]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-044a3f6b-489d-414f-8e3b-92d2fc7cbb4b tempest-GroupsTest-130131857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.821s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:45 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-044a3f6b-489d-414f-8e3b-92d2fc7cbb4b tempest-GroupsTest-130131857 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:11:45 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-044a3f6b-489d-414f-8e3b-92d2fc7cbb4b tempest-GroupsTest-130131857 None] Delete group completed successfully. Jul 08 01:11:46 devstack sudo[94391]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-f37ca93e-b0ea-493e-9db7-49b473fd196e req-b63a414c-6a89-4b55-852c-2f92f2d3eb10 tempest-VolumesSnapshotsTestJSON-49290421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e366b68-ad87-47dc-9a42-76f8ada76a42 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42.4c03c84f-2185-4417-870b-3595b0433211" returned: 0 in 2.349s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:46 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [req-f37ca93e-b0ea-493e-9db7-49b473fd196e req-b63a414c-6a89-4b55-852c-2f92f2d3eb10 tempest-VolumesSnapshotsTestJSON-49290421 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42.4c03c84f-2185-4417-870b-3595b0433211 is being set with open permissions: ugo+rw Jul 08 01:11:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-f37ca93e-b0ea-493e-9db7-49b473fd196e req-b63a414c-6a89-4b55-852c-2f92f2d3eb10 tempest-VolumesSnapshotsTestJSON-49290421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42.4c03c84f-2185-4417-870b-3595b0433211 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:46 devstack sudo[94427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42.4c03c84f-2185-4417-870b-3595b0433211 Jul 08 01:11:46 devstack sudo[94427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:47 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 2.303s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:47 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:11:47 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:11:47 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread count: 8 {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:11:47 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread info: [<_MainThread(MainThread, started 134382216167552)>, , , , , , , ] {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:11:47 devstack sudo[94427]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-f37ca93e-b0ea-493e-9db7-49b473fd196e req-b63a414c-6a89-4b55-852c-2f92f2d3eb10 tempest-VolumesSnapshotsTestJSON-49290421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42.4c03c84f-2185-4417-870b-3595b0433211" returned: 0 in 1.573s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-f37ca93e-b0ea-493e-9db7-49b473fd196e req-b63a414c-6a89-4b55-852c-2f92f2d3eb10 tempest-VolumesSnapshotsTestJSON-49290421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:48 devstack sudo[94434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42.info Jul 08 01:11:48 devstack sudo[94434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:49 devstack sudo[94434]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-f37ca93e-b0ea-493e-9db7-49b473fd196e req-b63a414c-6a89-4b55-852c-2f92f2d3eb10 tempest-VolumesSnapshotsTestJSON-49290421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42.info" returned: 0 in 1.226s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:49 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [req-f37ca93e-b0ea-493e-9db7-49b473fd196e req-b63a414c-6a89-4b55-852c-2f92f2d3eb10 tempest-VolumesSnapshotsTestJSON-49290421 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42.info is being set with open permissions: ugo+rw Jul 08 01:11:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-f37ca93e-b0ea-493e-9db7-49b473fd196e req-b63a414c-6a89-4b55-852c-2f92f2d3eb10 tempest-VolumesSnapshotsTestJSON-49290421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:49 devstack sudo[94438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42.info Jul 08 01:11:49 devstack sudo[94438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:50 devstack sudo[94438]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-f37ca93e-b0ea-493e-9db7-49b473fd196e req-b63a414c-6a89-4b55-852c-2f92f2d3eb10 tempest-VolumesSnapshotsTestJSON-49290421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42.info" returned: 0 in 1.453s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-f37ca93e-b0ea-493e-9db7-49b473fd196e req-b63a414c-6a89-4b55-852c-2f92f2d3eb10 tempest-VolumesSnapshotsTestJSON-49290421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 10.180s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:50 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-f37ca93e-b0ea-493e-9db7-49b473fd196e req-b63a414c-6a89-4b55-852c-2f92f2d3eb10 tempest-VolumesSnapshotsTestJSON-49290421 None] Create snapshot completed successfully Jul 08 01:11:51 devstack cinder-volume[87022]: DEBUG cinder.coordination [req-1f341e7c-64a2-4b25-8350-3303c747cb63 req-a57c9f37-882c-4012-9c0e-98dee1f34466 tempest-VolumesSnapshotsTestJSON-49290421 None] Acquiring lock "cinder-4c03c84f-2185-4417-870b-3595b0433211-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:51 devstack cinder-volume[87022]: DEBUG cinder.coordination [req-1f341e7c-64a2-4b25-8350-3303c747cb63 req-a57c9f37-882c-4012-9c0e-98dee1f34466 tempest-VolumesSnapshotsTestJSON-49290421 None] Lock "cinder-4c03c84f-2185-4417-870b-3595b0433211-delete_snapshot" acquired by "delete_snapshot" :: waited 0.075s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:51 devstack cinder-volume[87022]: DEBUG cinder.coordination [req-1f341e7c-64a2-4b25-8350-3303c747cb63 req-a57c9f37-882c-4012-9c0e-98dee1f34466 tempest-VolumesSnapshotsTestJSON-49290421 None] Acquiring lock "cinder-quobyte-9e366b68-ad87-47dc-9a42-76f8ada76a42" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:51 devstack cinder-volume[87022]: DEBUG cinder.coordination [req-1f341e7c-64a2-4b25-8350-3303c747cb63 req-a57c9f37-882c-4012-9c0e-98dee1f34466 tempest-VolumesSnapshotsTestJSON-49290421 None] Lock "cinder-quobyte-9e366b68-ad87-47dc-9a42-76f8ada76a42" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:51 devstack cinder-volume[87022]: DEBUG cinder.coordination [req-1f341e7c-64a2-4b25-8350-3303c747cb63 req-a57c9f37-882c-4012-9c0e-98dee1f34466 tempest-VolumesSnapshotsTestJSON-49290421 None] Acquiring lock "cinder-quobyte-4c03c84f-2185-4417-870b-3595b0433211" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:51 devstack cinder-volume[87022]: DEBUG cinder.coordination [req-1f341e7c-64a2-4b25-8350-3303c747cb63 req-a57c9f37-882c-4012-9c0e-98dee1f34466 tempest-VolumesSnapshotsTestJSON-49290421 None] Lock "cinder-quobyte-4c03c84f-2185-4417-870b-3595b0433211" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:51 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [req-1f341e7c-64a2-4b25-8350-3303c747cb63 req-a57c9f37-882c-4012-9c0e-98dee1f34466 tempest-VolumesSnapshotsTestJSON-49290421 None] Deleting offline snapshot 4c03c84f-2185-4417-870b-3595b0433211 of volume 9e366b68-ad87-47dc-9a42-76f8ada76a42 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:11:51 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [req-1f341e7c-64a2-4b25-8350-3303c747cb63 req-a57c9f37-882c-4012-9c0e-98dee1f34466 tempest-VolumesSnapshotsTestJSON-49290421 None] snapshot_file for this snap is: volume-9e366b68-ad87-47dc-9a42-76f8ada76a42.4c03c84f-2185-4417-870b-3595b0433211 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:11:51 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d7daaa-c0ea-4750-a0ce-24a75b43201f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-1f341e7c-64a2-4b25-8350-3303c747cb63 req-a57c9f37-882c-4012-9c0e-98dee1f34466 tempest-VolumesSnapshotsTestJSON-49290421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42.4c03c84f-2185-4417-870b-3595b0433211 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:51 devstack sudo[94442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42.4c03c84f-2185-4417-870b-3595b0433211 Jul 08 01:11:51 devstack sudo[94442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:53 devstack sudo[94442]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-1f341e7c-64a2-4b25-8350-3303c747cb63 req-a57c9f37-882c-4012-9c0e-98dee1f34466 tempest-VolumesSnapshotsTestJSON-49290421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42.4c03c84f-2185-4417-870b-3595b0433211" returned: 0 in 2.180s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:53 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [req-1f341e7c-64a2-4b25-8350-3303c747cb63 req-a57c9f37-882c-4012-9c0e-98dee1f34466 tempest-VolumesSnapshotsTestJSON-49290421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e366b68-ad87-47dc-9a42-76f8ada76a42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:11:53 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ab95d0-6c7c-4661-b905-356725ff3e0e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-1f341e7c-64a2-4b25-8350-3303c747cb63 req-a57c9f37-882c-4012-9c0e-98dee1f34466 tempest-VolumesSnapshotsTestJSON-49290421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:54 devstack sudo[94447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42 Jul 08 01:11:54 devstack sudo[94447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:55 devstack sudo[94447]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-1f341e7c-64a2-4b25-8350-3303c747cb63 req-a57c9f37-882c-4012-9c0e-98dee1f34466 tempest-VolumesSnapshotsTestJSON-49290421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42" returned: 0 in 1.511s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-1f341e7c-64a2-4b25-8350-3303c747cb63 req-a57c9f37-882c-4012-9c0e-98dee1f34466 tempest-VolumesSnapshotsTestJSON-49290421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42.4c03c84f-2185-4417-870b-3595b0433211 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:55 devstack sudo[94454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42.4c03c84f-2185-4417-870b-3595b0433211 Jul 08 01:11:55 devstack sudo[94454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:55 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-c955547d-1084-4cb3-9bc4-b16f01672cef tempest-GroupsV314Test-1516875730 None] Group tempest-GroupsV314Test-Group-791743833: creating Jul 08 01:11:55 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-c955547d-1084-4cb3-9bc4-b16f01672cef tempest-GroupsV314Test-1516875730 None] Group tempest-GroupsV314Test-Group-791743833: created successfully Jul 08 01:11:55 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-c955547d-1084-4cb3-9bc4-b16f01672cef tempest-GroupsV314Test-1516875730 None] Create group completed successfully. Jul 08 01:11:56 devstack sudo[94454]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-1f341e7c-64a2-4b25-8350-3303c747cb63 req-a57c9f37-882c-4012-9c0e-98dee1f34466 tempest-VolumesSnapshotsTestJSON-49290421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42.4c03c84f-2185-4417-870b-3595b0433211" returned: 0 in 1.158s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-1f341e7c-64a2-4b25-8350-3303c747cb63 req-a57c9f37-882c-4012-9c0e-98dee1f34466 tempest-VolumesSnapshotsTestJSON-49290421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42.4c03c84f-2185-4417-870b-3595b0433211 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:56 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42.4c03c84f-2185-4417-870b-3595b0433211 Jul 08 01:11:56 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:57 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-1f341e7c-64a2-4b25-8350-3303c747cb63 req-a57c9f37-882c-4012-9c0e-98dee1f34466 tempest-VolumesSnapshotsTestJSON-49290421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42.4c03c84f-2185-4417-870b-3595b0433211" returned: 0 in 0.728s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:57 devstack cinder-volume[87022]: DEBUG cinder.coordination [req-1f341e7c-64a2-4b25-8350-3303c747cb63 req-a57c9f37-882c-4012-9c0e-98dee1f34466 tempest-VolumesSnapshotsTestJSON-49290421 None] Lock "cinder-quobyte-4c03c84f-2185-4417-870b-3595b0433211" released by "_delete_snapshot" :: held 5.780s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:57 devstack cinder-volume[87022]: DEBUG cinder.coordination [req-1f341e7c-64a2-4b25-8350-3303c747cb63 req-a57c9f37-882c-4012-9c0e-98dee1f34466 tempest-VolumesSnapshotsTestJSON-49290421 None] Lock "cinder-quobyte-9e366b68-ad87-47dc-9a42-76f8ada76a42" released by "delete_snapshot" :: held 5.834s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:57 devstack cinder-volume[87022]: WARNING cinder.quota [req-1f341e7c-64a2-4b25-8350-3303c747cb63 req-a57c9f37-882c-4012-9c0e-98dee1f34466 tempest-VolumesSnapshotsTestJSON-49290421 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:11:57 devstack cinder-volume[87022]: DEBUG cinder.quota [req-1f341e7c-64a2-4b25-8350-3303c747cb63 req-a57c9f37-882c-4012-9c0e-98dee1f34466 tempest-VolumesSnapshotsTestJSON-49290421 None] Created reservations ['1c98f2d9-589e-4f24-a40b-c185856b7ab0', '318d90ee-8300-450c-b752-7cdbc0fbebeb', '1741c292-ef52-4ea9-88e0-a2a73f264a28', 'ee4a5566-5b3f-4fbf-8a36-211db16c264a'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:11:57 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-1f341e7c-64a2-4b25-8350-3303c747cb63 req-a57c9f37-882c-4012-9c0e-98dee1f34466 tempest-VolumesSnapshotsTestJSON-49290421 None] Delete snapshot completed successfully. Jul 08 01:11:57 devstack cinder-volume[87022]: DEBUG cinder.coordination [req-1f341e7c-64a2-4b25-8350-3303c747cb63 req-a57c9f37-882c-4012-9c0e-98dee1f34466 tempest-VolumesSnapshotsTestJSON-49290421 None] Lock "cinder-4c03c84f-2185-4417-870b-3595b0433211-delete_snapshot" released by "delete_snapshot" :: held 6.070s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:57 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:11:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Flow 'volume_create_manager' (28ee42eb-eedc-4f18-a2d5-50da004845a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:11:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da62434-a0a4-4b4b-8299-b37c525038a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da62434-a0a4-4b4b-8299-b37c525038a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-114450610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=55331128-7d6d-49ae-be48-6c4b9dd026af,host='devstack@QuobyteHD#QuobyteHD',id=c39e4b55-359c-4b9e-9b08-ed117abd58c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af720eeed6c241ff98947fe69b5b4d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:11:57Z,use_quota=True,user_id='5ebad64c1d224e208ad4f59f75f4ed88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e595c388-87f1-4a1c-a102-24c8096d39c0),volume_type_id=e595c388-87f1-4a1c-a102-24c8096d39c0)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f6327f5-bcc7-4f64-8c63-99839343cfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f6327f5-bcc7-4f64-8c63-99839343cfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c92679f-e1fe-49c1-a9f0-ccb713363da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c92679f-e1fe-49c1-a9f0-ccb713363da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c39e4b55-359c-4b9e-9b08-ed117abd58c0', 'volume_name': 'volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3800a339-8445-460b-a243-89388e914014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3800a339-8445-460b-a243-89388e914014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (041e0e9a-1183-4a61-b7e1-f01db83478d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:57 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Volume c39e4b55-359c-4b9e-9b08-ed117abd58c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0', 'volume_size': 1} Jul 08 01:11:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:57 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=55331128-7d6d-49ae-be48-6c4b9dd026af,created_at=2026-07-07T23:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-114450610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=55331128-7d6d-49ae-be48-6c4b9dd026af,host='devstack@QuobyteHD#QuobyteHD',id=c39e4b55-359c-4b9e-9b08-ed117abd58c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af720eeed6c241ff98947fe69b5b4d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:11:57Z,use_quota=True,user_id='5ebad64c1d224e208ad4f59f75f4ed88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e595c388-87f1-4a1c-a102-24c8096d39c0),volume_type_id=e595c388-87f1-4a1c-a102-24c8096d39c0)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:11:57 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Creating volume c39e4b55-359c-4b9e-9b08-ed117abd58c0 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:11:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:57 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:11:57 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:11:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:57 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:11:57 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:11:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:57 devstack sudo[94504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0 1073741824 Jul 08 01:11:57 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [req-b25adecd-02d4-4de2-a414-0c9e7a80a6ed req-d668b2fc-7ed3-43c0-83bd-2b181afe8399 tempest-VolumesSnapshotsTestJSON-49290421 None] Acquiring lock "cinder-9e366b68-ad87-47dc-9a42-76f8ada76a42-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [req-b25adecd-02d4-4de2-a414-0c9e7a80a6ed req-d668b2fc-7ed3-43c0-83bd-2b181afe8399 tempest-VolumesSnapshotsTestJSON-49290421 None] Lock "cinder-9e366b68-ad87-47dc-9a42-76f8ada76a42-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [req-b25adecd-02d4-4de2-a414-0c9e7a80a6ed req-d668b2fc-7ed3-43c0-83bd-2b181afe8399 tempest-VolumesSnapshotsTestJSON-49290421 None] Acquiring lock "cinder-quobyte-9e366b68-ad87-47dc-9a42-76f8ada76a42" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [req-b25adecd-02d4-4de2-a414-0c9e7a80a6ed req-d668b2fc-7ed3-43c0-83bd-2b181afe8399 tempest-VolumesSnapshotsTestJSON-49290421 None] Lock "cinder-quobyte-9e366b68-ad87-47dc-9a42-76f8ada76a42" acquired by "delete_volume" :: waited 0.018s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:58 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9285bc1-3300-463a-ab21-c8bb391c3232]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-b25adecd-02d4-4de2-a414-0c9e7a80a6ed req-d668b2fc-7ed3-43c0-83bd-2b181afe8399 tempest-VolumesSnapshotsTestJSON-49290421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:58 devstack sudo[94510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42 Jul 08 01:11:58 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:58 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0 1073741824" returned: 0 in 0.941s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:58 devstack sudo[94512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0 Jul 08 01:11:58 devstack sudo[94512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:59 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-b25adecd-02d4-4de2-a414-0c9e7a80a6ed req-d668b2fc-7ed3-43c0-83bd-2b181afe8399 tempest-VolumesSnapshotsTestJSON-49290421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42" returned: 0 in 0.820s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-b25adecd-02d4-4de2-a414-0c9e7a80a6ed req-d668b2fc-7ed3-43c0-83bd-2b181afe8399 tempest-VolumesSnapshotsTestJSON-49290421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:59 devstack sudo[94517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42 Jul 08 01:11:59 devstack sudo[94517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:59 devstack sudo[94512]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0" returned: 0 in 0.778s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:11:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (041e0e9a-1183-4a61-b7e1-f01db83478d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (087711d8-e96b-4fbc-8ff7-cd7ec66b96ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:59 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Volume volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0 (c39e4b55-359c-4b9e-9b08-ed117abd58c0): created successfully Jul 08 01:11:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (087711d8-e96b-4fbc-8ff7-cd7ec66b96ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Flow 'volume_create_manager' (28ee42eb-eedc-4f18-a2d5-50da004845a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:11:59 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-43c8564d-9dee-47d7-b5df-66585470aa50 tempest-GroupsV314Test-1516875730 None] Created volume successfully. Jul 08 01:12:00 devstack sudo[94517]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-b25adecd-02d4-4de2-a414-0c9e7a80a6ed req-d668b2fc-7ed3-43c0-83bd-2b181afe8399 tempest-VolumesSnapshotsTestJSON-49290421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9e366b68-ad87-47dc-9a42-76f8ada76a42" returned: 0 in 0.794s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:00 devstack cinder-volume[87022]: DEBUG cinder.coordination [req-b25adecd-02d4-4de2-a414-0c9e7a80a6ed req-d668b2fc-7ed3-43c0-83bd-2b181afe8399 tempest-VolumesSnapshotsTestJSON-49290421 None] Lock "cinder-quobyte-9e366b68-ad87-47dc-9a42-76f8ada76a42" released by "delete_volume" :: held 1.698s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:00 devstack cinder-volume[87022]: DEBUG cinder.quota [req-b25adecd-02d4-4de2-a414-0c9e7a80a6ed req-d668b2fc-7ed3-43c0-83bd-2b181afe8399 tempest-VolumesSnapshotsTestJSON-49290421 None] Created reservations ['9cca1b9e-67f1-41d1-9487-3ba53e80e03c', '9a24040e-84dd-4fa7-9a04-52a7e5a8a7df', '332306c2-6a30-4edd-8f72-4c034a40d00f', '778a3af4-9153-4508-99b9-d46d37ab9fdc'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:12:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-b25adecd-02d4-4de2-a414-0c9e7a80a6ed req-d668b2fc-7ed3-43c0-83bd-2b181afe8399 tempest-VolumesSnapshotsTestJSON-49290421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-b25adecd-02d4-4de2-a414-0c9e7a80a6ed req-d668b2fc-7ed3-43c0-83bd-2b181afe8399 tempest-VolumesSnapshotsTestJSON-49290421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:00 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [req-b25adecd-02d4-4de2-a414-0c9e7a80a6ed req-d668b2fc-7ed3-43c0-83bd-2b181afe8399 tempest-VolumesSnapshotsTestJSON-49290421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:00 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [req-b25adecd-02d4-4de2-a414-0c9e7a80a6ed req-d668b2fc-7ed3-43c0-83bd-2b181afe8399 tempest-VolumesSnapshotsTestJSON-49290421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-b25adecd-02d4-4de2-a414-0c9e7a80a6ed req-d668b2fc-7ed3-43c0-83bd-2b181afe8399 tempest-VolumesSnapshotsTestJSON-49290421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-b25adecd-02d4-4de2-a414-0c9e7a80a6ed req-d668b2fc-7ed3-43c0-83bd-2b181afe8399 tempest-VolumesSnapshotsTestJSON-49290421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:00 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:12:00 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:01 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-b25adecd-02d4-4de2-a414-0c9e7a80a6ed req-d668b2fc-7ed3-43c0-83bd-2b181afe8399 tempest-VolumesSnapshotsTestJSON-49290421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.763s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:01 devstack cinder-volume[87022]: DEBUG cinder.manager [req-b25adecd-02d4-4de2-a414-0c9e7a80a6ed req-d668b2fc-7ed3-43c0-83bd-2b181afe8399 tempest-VolumesSnapshotsTestJSON-49290421 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:12:01 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-b25adecd-02d4-4de2-a414-0c9e7a80a6ed req-d668b2fc-7ed3-43c0-83bd-2b181afe8399 tempest-VolumesSnapshotsTestJSON-49290421 None] Deleted volume successfully. Jul 08 01:12:01 devstack cinder-volume[87022]: DEBUG cinder.coordination [req-b25adecd-02d4-4de2-a414-0c9e7a80a6ed req-d668b2fc-7ed3-43c0-83bd-2b181afe8399 tempest-VolumesSnapshotsTestJSON-49290421 None] Lock "cinder-9e366b68-ad87-47dc-9a42-76f8ada76a42-delete_volume" released by "delete_volume" :: held 2.764s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:01 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Cloning volume c39e4b55-359c-4b9e-9b08-ed117abd58c0 to volume e2f717e9-f102-4900-813e-db8af2e02575 Jul 08 01:12:01 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:DELETE=4,cinder:UPDATE=80,cinder:SELECT=86,cinder:INSERT=22 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:12:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Creating offline snapshot c48a56f7-3e97-4e44-b962-f7b64a823355 of volume c39e4b55-359c-4b9e-9b08-ed117abd58c0 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:12:01 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c325c7eb-bfe7-430e-a9e7-f6109d793780]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:01 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0 Jul 08 01:12:01 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:02 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0" returned: 0 in 0.938s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.c48a56f7-3e97-4e44-b962-f7b64a823355 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:02 devstack sudo[94548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.c48a56f7-3e97-4e44-b962-f7b64a823355 1G Jul 08 01:12:02 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:03 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.c48a56f7-3e97-4e44-b962-f7b64a823355 1G" returned: 0 in 1.256s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.c48a56f7-3e97-4e44-b962-f7b64a823355 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:03 devstack sudo[94603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.c48a56f7-3e97-4e44-b962-f7b64a823355 Jul 08 01:12:03 devstack sudo[94603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:04 devstack sudo[94603]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.c48a56f7-3e97-4e44-b962-f7b64a823355" returned: 0 in 0.852s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:04 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.c48a56f7-3e97-4e44-b962-f7b64a823355 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:12:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.c48a56f7-3e97-4e44-b962-f7b64a823355 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:04 devstack sudo[94610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.c48a56f7-3e97-4e44-b962-f7b64a823355 Jul 08 01:12:04 devstack sudo[94610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:05 devstack sudo[94610]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.c48a56f7-3e97-4e44-b962-f7b64a823355" returned: 0 in 0.781s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:05 devstack sudo[94613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.info Jul 08 01:12:05 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:05 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:12:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Flow 'volume_create_manager' (bf34915b-f3a8-45de-8210-b961643ebe03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:12:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd73e4eb-b8c4-4142-9b58-730973d8cbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd73e4eb-b8c4-4142-9b58-730973d8cbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1406542488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c599c3-575b-4f9a-9dfd-d1cd71acc0e9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d8f8b2f0a61f491ca0ede640cad0d669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:12:06Z,use_quota=True,user_id='5452086c96194f01a58e98524d9a8478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ae0c9ea-ee3a-4e85-b481-9cf9f1e8bd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ae0c9ea-ee3a-4e85-b481-9cf9f1e8bd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff33dbc-cd01-48a5-ab46-805aac62eb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff33dbc-cd01-48a5-ab46-805aac62eb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32c599c3-575b-4f9a-9dfd-d1cd71acc0e9', 'volume_name': 'volume-32c599c3-575b-4f9a-9dfd-d1cd71acc0e9', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53db540c-92cf-4c77-9f19-16500d8c259c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53db540c-92cf-4c77-9f19-16500d8c259c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b01fa8a-6240-47f0-a073-446a407af8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:05 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Volume 32c599c3-575b-4f9a-9dfd-d1cd71acc0e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32c599c3-575b-4f9a-9dfd-d1cd71acc0e9', 'volume_size': 1} Jul 08 01:12:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:05 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.info" returned: 0 in 0.726s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:05 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:12:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:05 devstack sudo[94617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.info Jul 08 01:12:06 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:06 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.info" returned: 0 in 0.625s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:06 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Acquiring lock "cinder-quobyte-e2f717e9-f102-4900-813e-db8af2e02575" by "_copy_volume_from_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:06 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Lock "cinder-quobyte-e2f717e9-f102-4900-813e-db8af2e02575" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:06 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] snapshot: c48a56f7-3e97-4e44-b962-f7b64a823355, volume: e2f717e9-f102-4900-813e-db8af2e02575, {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:12:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:06 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:06 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:06 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f592a79-bdc5-47a9-a148-5236b572f9ae]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.c48a56f7-3e97-4e44-b962-f7b64a823355 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:06 devstack sudo[94620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.c48a56f7-3e97-4e44-b962-f7b64a823355 Jul 08 01:12:06 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:07 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.c48a56f7-3e97-4e44-b962-f7b64a823355" returned: 0 in 0.810s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:07 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:12:07 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] will copy from snapshot at /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0 {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:12:07 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Creating direct copy from snapshot {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:12:07 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[1653bbe2-8f11-43ad-90dd-733bcbc932d4]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:07 devstack sudo[94626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0 Jul 08 01:12:07 devstack sudo[94626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:08 devstack sudo[94626]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0" returned: 0 in 0.819s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:08 devstack cinder-volume[87022]: DEBUG cinder.utils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Path /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e2f717e9-f102-4900-813e-db8af2e02575 not found in is_blk_device check {{(pid=87022) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:12:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e2f717e9-f102-4900-813e-db8af2e02575 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:08 devstack sudo[94633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e2f717e9-f102-4900-813e-db8af2e02575 Jul 08 01:12:08 devstack sudo[94633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:11 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:12:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Flow 'volume_create_manager' (c119b683-f465-4632-a20d-9d00949879e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:12:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ef9ae7-4f0d-4938-b265-6e0411fdb41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ef9ae7-4f0d-4938-b265-6e0411fdb41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2043639728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f9870f-2660-4258-b63f-a7423f5ea693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c92b41a8c8d44b81a54ec8b95273ca6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:12:11Z,use_quota=True,user_id='f9c3dd452069487a99049969dbb9ea6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (620a8574-2f4e-41aa-85de-b434c7d85f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (620a8574-2f4e-41aa-85de-b434c7d85f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc18708a-31ea-4684-9bb6-8196f2a6a591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc18708a-31ea-4684-9bb6-8196f2a6a591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9f9870f-2660-4258-b63f-a7423f5ea693', 'volume_name': 'volume-a9f9870f-2660-4258-b63f-a7423f5ea693', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f44a83ca-c91e-4de0-98d8-a611bbd52363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f44a83ca-c91e-4de0-98d8-a611bbd52363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7c94b0-8f9c-4e36-8ce7-6160944540fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:11 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Volume a9f9870f-2660-4258-b63f-a7423f5ea693: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9f9870f-2660-4258-b63f-a7423f5ea693', 'volume_size': 1} Jul 08 01:12:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:13 devstack sudo[94633]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e2f717e9-f102-4900-813e-db8af2e02575" returned: 0 in 5.127s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:13 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cf947b-eb2c-4216-898d-8e5ba692caf6]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:13 devstack sudo[94650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0 Jul 08 01:12:13 devstack sudo[94650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:14 devstack sudo[94650]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0" returned: 0 in 0.963s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:14 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Image conversion details: src /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0, size 1024.00 MB, duration 5.13 sec, destination /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e2f717e9-f102-4900-813e-db8af2e02575 {{(pid=87022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:12:14 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Converted 1024.00 MB image at 199.71 MB/s Jul 08 01:12:14 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e2f717e9-f102-4900-813e-db8af2e02575 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:12:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e2f717e9-f102-4900-813e-db8af2e02575 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:14 devstack sudo[94663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e2f717e9-f102-4900-813e-db8af2e02575 Jul 08 01:12:14 devstack sudo[94663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:14 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:12:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Flow 'volume_create_manager' (b09ec55f-2df8-45b2-8d2f-ceeb94d0be37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:12:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8dbe3a6-ccfb-4d4b-b992-c28018f6ebbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8dbe3a6-ccfb-4d4b-b992-c28018f6ebbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1227145182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a1a7aa-e67c-4b24-a55c-83deea43782e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='157306108d124cf49329a4cc793bccee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:12:15Z,use_quota=True,user_id='c3db039932bf477285561c8cb7e18fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d3d79fe-cf54-46c9-89a0-2904929cca31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d3d79fe-cf54-46c9-89a0-2904929cca31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0ef8cae-7bf3-427f-a4cf-3df6161f0f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0ef8cae-7bf3-427f-a4cf-3df6161f0f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15a1a7aa-e67c-4b24-a55c-83deea43782e', 'volume_name': 'volume-15a1a7aa-e67c-4b24-a55c-83deea43782e', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76cb082-771f-40b8-a9f0-b988aa6723de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76cb082-771f-40b8-a9f0-b988aa6723de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a897272-eb9c-45ec-b90e-ee1417d9d118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:15 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Volume 15a1a7aa-e67c-4b24-a55c-83deea43782e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15a1a7aa-e67c-4b24-a55c-83deea43782e', 'volume_size': 1} Jul 08 01:12:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:15 devstack sudo[94663]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e2f717e9-f102-4900-813e-db8af2e02575" returned: 0 in 0.703s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Lock "cinder-quobyte-e2f717e9-f102-4900-813e-db8af2e02575" released by "_copy_volume_from_snapshot" :: held 8.502s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Acquiring lock "cinder-quobyte-c48a56f7-3e97-4e44-b962-f7b64a823355" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Lock "cinder-quobyte-c48a56f7-3e97-4e44-b962-f7b64a823355" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:15 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Deleting offline snapshot c48a56f7-3e97-4e44-b962-f7b64a823355 of volume c39e4b55-359c-4b9e-9b08-ed117abd58c0 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:12:15 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] snapshot_file for this snap is: volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.c48a56f7-3e97-4e44-b962-f7b64a823355 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:12:15 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[832061c1-54c5-499d-802d-bcd151812e29]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.c48a56f7-3e97-4e44-b962-f7b64a823355 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:15 devstack sudo[94666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.c48a56f7-3e97-4e44-b962-f7b64a823355 Jul 08 01:12:15 devstack sudo[94666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:15 devstack sudo[94666]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.c48a56f7-3e97-4e44-b962-f7b64a823355" returned: 0 in 0.781s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:15 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:12:15 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a804d3-a29c-423b-a4bf-b74cd7fe375e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:16 devstack sudo[94671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0 Jul 08 01:12:16 devstack sudo[94671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:16 devstack sudo[94671]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0" returned: 0 in 0.805s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.c48a56f7-3e97-4e44-b962-f7b64a823355 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:16 devstack sudo[94676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.c48a56f7-3e97-4e44-b962-f7b64a823355 Jul 08 01:12:16 devstack sudo[94676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:17 devstack sudo[94676]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.c48a56f7-3e97-4e44-b962-f7b64a823355" returned: 0 in 0.771s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.c48a56f7-3e97-4e44-b962-f7b64a823355 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:17 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.c48a56f7-3e97-4e44-b962-f7b64a823355 Jul 08 01:12:17 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:18 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0.c48a56f7-3e97-4e44-b962-f7b64a823355" returned: 0 in 0.723s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Lock "cinder-quobyte-c48a56f7-3e97-4e44-b962-f7b64a823355" released by "_delete_snapshot" :: held 3.187s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.105s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.465s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1406542488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c599c3-575b-4f9a-9dfd-d1cd71acc0e9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d8f8b2f0a61f491ca0ede640cad0d669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:12:06Z,use_quota=True,user_id='5452086c96194f01a58e98524d9a8478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:12:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Creating volume 32c599c3-575b-4f9a-9dfd-d1cd71acc0e9 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:12:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:12:18 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:12:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32c599c3-575b-4f9a-9dfd-d1cd71acc0e9 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:18 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32c599c3-575b-4f9a-9dfd-d1cd71acc0e9 1073741824 Jul 08 01:12:18 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:18 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-1ef17350-aa7d-491a-9c6d-3b3ff646e227 tempest-GroupsV314Test-1516875730 None] Create group from source-group-55331128-7d6d-49ae-be48-6c4b9dd026af completed successfully. Jul 08 01:12:19 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32c599c3-575b-4f9a-9dfd-d1cd71acc0e9 1073741824" returned: 0 in 0.989s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32c599c3-575b-4f9a-9dfd-d1cd71acc0e9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:19 devstack sudo[94692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32c599c3-575b-4f9a-9dfd-d1cd71acc0e9 Jul 08 01:12:19 devstack sudo[94692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-baa17dd5-6c87-48e7-b401-b5fdd0eaf268 tempest-GroupsV314Test-1516875730 None] Acquiring lock "cinder-quobyte-e2f717e9-f102-4900-813e-db8af2e02575" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-baa17dd5-6c87-48e7-b401-b5fdd0eaf268 tempest-GroupsV314Test-1516875730 None] Lock "cinder-quobyte-e2f717e9-f102-4900-813e-db8af2e02575" acquired by "delete_volume" :: waited 0.017s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:19 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2690c72f-bff8-47a7-8c15-3aed5ae69283]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-baa17dd5-6c87-48e7-b401-b5fdd0eaf268 tempest-GroupsV314Test-1516875730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e2f717e9-f102-4900-813e-db8af2e02575 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:19 devstack sudo[94694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e2f717e9-f102-4900-813e-db8af2e02575 Jul 08 01:12:19 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:20 devstack sudo[94692]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32c599c3-575b-4f9a-9dfd-d1cd71acc0e9" returned: 0 in 0.889s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:20 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] <== create_volume: return (1924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:12:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.928s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.533s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:20 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2043639728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f9870f-2660-4258-b63f-a7423f5ea693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c92b41a8c8d44b81a54ec8b95273ca6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:12:11Z,use_quota=True,user_id='f9c3dd452069487a99049969dbb9ea6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:12:20 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Creating volume a9f9870f-2660-4258-b63f-a7423f5ea693 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:12:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:20 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:20 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:20 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:12:20 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:12:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a9f9870f-2660-4258-b63f-a7423f5ea693 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:20 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b01fa8a-6240-47f0-a073-446a407af8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32c599c3-575b-4f9a-9dfd-d1cd71acc0e9', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:20 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a9f9870f-2660-4258-b63f-a7423f5ea693 1073741824 Jul 08 01:12:20 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:20 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3815da0-cf89-44b0-9b46-7aa87092f90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:20 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Volume volume-32c599c3-575b-4f9a-9dfd-d1cd71acc0e9 (32c599c3-575b-4f9a-9dfd-d1cd71acc0e9): created successfully Jul 08 01:12:20 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3815da0-cf89-44b0-9b46-7aa87092f90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:20 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Flow 'volume_create_manager' (bf34915b-f3a8-45de-8210-b961643ebe03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:12:20 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-df763331-ba96-4015-b6bc-69cfd3c1d395 req-0f49e36b-8ccd-4e67-a1f5-1ed0cf30ea99 tempest-VolumesGetTestJSON-1242940299 None] Created volume successfully. Jul 08 01:12:20 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-baa17dd5-6c87-48e7-b401-b5fdd0eaf268 tempest-GroupsV314Test-1516875730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e2f717e9-f102-4900-813e-db8af2e02575" returned: 0 in 1.059s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-baa17dd5-6c87-48e7-b401-b5fdd0eaf268 tempest-GroupsV314Test-1516875730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e2f717e9-f102-4900-813e-db8af2e02575 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:20 devstack sudo[94703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e2f717e9-f102-4900-813e-db8af2e02575 Jul 08 01:12:20 devstack sudo[94703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [req-c227c346-9b37-4ec4-96f6-3927ad12d2a0 req-1e94e994-0bc8-4b8a-a3fc-0ba0b3e44d67 tempest-VolumesGetTestJSON-1242940299 None] Acquiring lock "cinder-32c599c3-575b-4f9a-9dfd-d1cd71acc0e9-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [req-c227c346-9b37-4ec4-96f6-3927ad12d2a0 req-1e94e994-0bc8-4b8a-a3fc-0ba0b3e44d67 tempest-VolumesGetTestJSON-1242940299 None] Lock "cinder-32c599c3-575b-4f9a-9dfd-d1cd71acc0e9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [req-c227c346-9b37-4ec4-96f6-3927ad12d2a0 req-1e94e994-0bc8-4b8a-a3fc-0ba0b3e44d67 tempest-VolumesGetTestJSON-1242940299 None] Acquiring lock "cinder-quobyte-32c599c3-575b-4f9a-9dfd-d1cd71acc0e9" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:21 devstack cinder-volume[87022]: DEBUG cinder.coordination [req-c227c346-9b37-4ec4-96f6-3927ad12d2a0 req-1e94e994-0bc8-4b8a-a3fc-0ba0b3e44d67 tempest-VolumesGetTestJSON-1242940299 None] Lock "cinder-quobyte-32c599c3-575b-4f9a-9dfd-d1cd71acc0e9" acquired by "delete_volume" :: waited 0.026s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:21 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14f06ae-33df-4040-b2be-cd473a06c4f7]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-c227c346-9b37-4ec4-96f6-3927ad12d2a0 req-1e94e994-0bc8-4b8a-a3fc-0ba0b3e44d67 tempest-VolumesGetTestJSON-1242940299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32c599c3-575b-4f9a-9dfd-d1cd71acc0e9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:21 devstack sudo[94708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32c599c3-575b-4f9a-9dfd-d1cd71acc0e9 Jul 08 01:12:21 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:21 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a9f9870f-2660-4258-b63f-a7423f5ea693 1073741824" returned: 0 in 1.126s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a9f9870f-2660-4258-b63f-a7423f5ea693 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:21 devstack sudo[94711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a9f9870f-2660-4258-b63f-a7423f5ea693 Jul 08 01:12:21 devstack sudo[94711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:21 devstack sudo[94703]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-baa17dd5-6c87-48e7-b401-b5fdd0eaf268 tempest-GroupsV314Test-1516875730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e2f717e9-f102-4900-813e-db8af2e02575" returned: 0 in 1.043s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:21 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-baa17dd5-6c87-48e7-b401-b5fdd0eaf268 tempest-GroupsV314Test-1516875730 None] Lock "cinder-quobyte-e2f717e9-f102-4900-813e-db8af2e02575" released by "delete_volume" :: held 2.162s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:21 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-baa17dd5-6c87-48e7-b401-b5fdd0eaf268 tempest-GroupsV314Test-1516875730 None] Created reservations ['4d70f06e-311e-4fe2-b8d9-0494fb207153'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:12:21 devstack cinder-volume[87022]: WARNING cinder.quota [None req-baa17dd5-6c87-48e7-b401-b5fdd0eaf268 tempest-GroupsV314Test-1516875730 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-169277166 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-169277166, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:12:21 devstack cinder-volume[87022]: WARNING cinder.quota [None req-baa17dd5-6c87-48e7-b401-b5fdd0eaf268 tempest-GroupsV314Test-1516875730 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-169277166 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-169277166, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:12:21 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-baa17dd5-6c87-48e7-b401-b5fdd0eaf268 tempest-GroupsV314Test-1516875730 None] Created reservations ['811715e4-1c67-4cd6-a923-9b5010aa7d91', '2f86adba-a2ea-4784-8bfb-cb21079435a3', 'f60f1bb7-6c6b-4f31-a851-7bded080251c', 'd38510aa-3619-4503-8d70-75fb3080ac2d'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:12:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-baa17dd5-6c87-48e7-b401-b5fdd0eaf268 tempest-GroupsV314Test-1516875730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-baa17dd5-6c87-48e7-b401-b5fdd0eaf268 tempest-GroupsV314Test-1516875730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-baa17dd5-6c87-48e7-b401-b5fdd0eaf268 tempest-GroupsV314Test-1516875730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-baa17dd5-6c87-48e7-b401-b5fdd0eaf268 tempest-GroupsV314Test-1516875730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-baa17dd5-6c87-48e7-b401-b5fdd0eaf268 tempest-GroupsV314Test-1516875730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-baa17dd5-6c87-48e7-b401-b5fdd0eaf268 tempest-GroupsV314Test-1516875730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:22 devstack sudo[94716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:12:22 devstack sudo[94716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:22 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-c227c346-9b37-4ec4-96f6-3927ad12d2a0 req-1e94e994-0bc8-4b8a-a3fc-0ba0b3e44d67 tempest-VolumesGetTestJSON-1242940299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32c599c3-575b-4f9a-9dfd-d1cd71acc0e9" returned: 0 in 1.115s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-c227c346-9b37-4ec4-96f6-3927ad12d2a0 req-1e94e994-0bc8-4b8a-a3fc-0ba0b3e44d67 tempest-VolumesGetTestJSON-1242940299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32c599c3-575b-4f9a-9dfd-d1cd71acc0e9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:22 devstack sudo[94718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32c599c3-575b-4f9a-9dfd-d1cd71acc0e9 Jul 08 01:12:22 devstack sudo[94718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:22 devstack sudo[94711]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a9f9870f-2660-4258-b63f-a7423f5ea693" returned: 0 in 0.941s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:22 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] <== create_volume: return (2132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:12:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.135s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.404s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:22 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1227145182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a1a7aa-e67c-4b24-a55c-83deea43782e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='157306108d124cf49329a4cc793bccee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:12:15Z,use_quota=True,user_id='c3db039932bf477285561c8cb7e18fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:12:22 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Creating volume 15a1a7aa-e67c-4b24-a55c-83deea43782e {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:12:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:22 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:22 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:22 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:12:22 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:12:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-15a1a7aa-e67c-4b24-a55c-83deea43782e 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:22 devstack sudo[94721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-15a1a7aa-e67c-4b24-a55c-83deea43782e 1073741824 Jul 08 01:12:22 devstack sudo[94721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:22 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7c94b0-8f9c-4e36-8ce7-6160944540fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9f9870f-2660-4258-b63f-a7423f5ea693', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:22 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded28cb7-9e34-4388-a8bb-8b7e9e03469b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:22 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Volume volume-a9f9870f-2660-4258-b63f-a7423f5ea693 (a9f9870f-2660-4258-b63f-a7423f5ea693): created successfully Jul 08 01:12:22 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded28cb7-9e34-4388-a8bb-8b7e9e03469b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:22 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Flow 'volume_create_manager' (c119b683-f465-4632-a20d-9d00949879e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:12:22 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-d2b4f5f1-9cdf-45d4-a41b-4ba55691f46e tempest-AttachVolumeTestJSON-1253782169 None] Created volume successfully. Jul 08 01:12:22 devstack sudo[94716]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-baa17dd5-6c87-48e7-b401-b5fdd0eaf268 tempest-GroupsV314Test-1516875730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.908s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:22 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-baa17dd5-6c87-48e7-b401-b5fdd0eaf268 tempest-GroupsV314Test-1516875730 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:12:22 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-baa17dd5-6c87-48e7-b401-b5fdd0eaf268 tempest-GroupsV314Test-1516875730 None] Delete group completed successfully. Jul 08 01:12:23 devstack sudo[94718]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-c227c346-9b37-4ec4-96f6-3927ad12d2a0 req-1e94e994-0bc8-4b8a-a3fc-0ba0b3e44d67 tempest-VolumesGetTestJSON-1242940299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32c599c3-575b-4f9a-9dfd-d1cd71acc0e9" returned: 0 in 0.883s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:23 devstack cinder-volume[87022]: DEBUG cinder.coordination [req-c227c346-9b37-4ec4-96f6-3927ad12d2a0 req-1e94e994-0bc8-4b8a-a3fc-0ba0b3e44d67 tempest-VolumesGetTestJSON-1242940299 None] Lock "cinder-quobyte-32c599c3-575b-4f9a-9dfd-d1cd71acc0e9" released by "delete_volume" :: held 2.063s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:23 devstack cinder-volume[87022]: DEBUG cinder.quota [req-c227c346-9b37-4ec4-96f6-3927ad12d2a0 req-1e94e994-0bc8-4b8a-a3fc-0ba0b3e44d67 tempest-VolumesGetTestJSON-1242940299 None] Created reservations ['8fa04e3d-6d17-47fd-8766-53cde212c203', '22d647c3-7cb2-4a06-be54-56860d876be1', '1ce4a0cd-00d0-44a6-a1fa-8c989cce547b', 'afda0de6-cb31-42bf-b635-03fff3f3eb72'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:12:23 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f706237b-a5c4-4a0e-96a6-f312dac8ab4b tempest-GroupsV314Test-1516875730 None] Acquiring lock "cinder-quobyte-c39e4b55-359c-4b9e-9b08-ed117abd58c0" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-c227c346-9b37-4ec4-96f6-3927ad12d2a0 req-1e94e994-0bc8-4b8a-a3fc-0ba0b3e44d67 tempest-VolumesGetTestJSON-1242940299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-c227c346-9b37-4ec4-96f6-3927ad12d2a0 req-1e94e994-0bc8-4b8a-a3fc-0ba0b3e44d67 tempest-VolumesGetTestJSON-1242940299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [req-c227c346-9b37-4ec4-96f6-3927ad12d2a0 req-1e94e994-0bc8-4b8a-a3fc-0ba0b3e44d67 tempest-VolumesGetTestJSON-1242940299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [req-c227c346-9b37-4ec4-96f6-3927ad12d2a0 req-1e94e994-0bc8-4b8a-a3fc-0ba0b3e44d67 tempest-VolumesGetTestJSON-1242940299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-c227c346-9b37-4ec4-96f6-3927ad12d2a0 req-1e94e994-0bc8-4b8a-a3fc-0ba0b3e44d67 tempest-VolumesGetTestJSON-1242940299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-c227c346-9b37-4ec4-96f6-3927ad12d2a0 req-1e94e994-0bc8-4b8a-a3fc-0ba0b3e44d67 tempest-VolumesGetTestJSON-1242940299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:23 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f706237b-a5c4-4a0e-96a6-f312dac8ab4b tempest-GroupsV314Test-1516875730 None] Lock "cinder-quobyte-c39e4b55-359c-4b9e-9b08-ed117abd58c0" acquired by "delete_volume" :: waited 0.055s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:23 devstack sudo[94728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:12:23 devstack sudo[94728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:23 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6d8b5a-8b02-4d85-a269-82aa40f27708]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f706237b-a5c4-4a0e-96a6-f312dac8ab4b tempest-GroupsV314Test-1516875730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:23 devstack sudo[94732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0 Jul 08 01:12:23 devstack sudo[94732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:23 devstack sudo[94721]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-15a1a7aa-e67c-4b24-a55c-83deea43782e 1073741824" returned: 0 in 1.253s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-15a1a7aa-e67c-4b24-a55c-83deea43782e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:23 devstack sudo[94737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-15a1a7aa-e67c-4b24-a55c-83deea43782e Jul 08 01:12:23 devstack sudo[94737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:24 devstack sudo[94728]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-c227c346-9b37-4ec4-96f6-3927ad12d2a0 req-1e94e994-0bc8-4b8a-a3fc-0ba0b3e44d67 tempest-VolumesGetTestJSON-1242940299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.793s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:24 devstack cinder-volume[87022]: DEBUG cinder.manager [req-c227c346-9b37-4ec4-96f6-3927ad12d2a0 req-1e94e994-0bc8-4b8a-a3fc-0ba0b3e44d67 tempest-VolumesGetTestJSON-1242940299 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:12:24 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-c227c346-9b37-4ec4-96f6-3927ad12d2a0 req-1e94e994-0bc8-4b8a-a3fc-0ba0b3e44d67 tempest-VolumesGetTestJSON-1242940299 None] Deleted volume successfully. Jul 08 01:12:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [req-c227c346-9b37-4ec4-96f6-3927ad12d2a0 req-1e94e994-0bc8-4b8a-a3fc-0ba0b3e44d67 tempest-VolumesGetTestJSON-1242940299 None] Lock "cinder-32c599c3-575b-4f9a-9dfd-d1cd71acc0e9-delete_volume" released by "delete_volume" :: held 3.322s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:24 devstack sudo[94732]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f706237b-a5c4-4a0e-96a6-f312dac8ab4b tempest-GroupsV314Test-1516875730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0" returned: 0 in 1.170s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f706237b-a5c4-4a0e-96a6-f312dac8ab4b tempest-GroupsV314Test-1516875730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:24 devstack sudo[94745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0 Jul 08 01:12:24 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:24 devstack sudo[94737]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-15a1a7aa-e67c-4b24-a55c-83deea43782e" returned: 0 in 0.931s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] <== create_volume: return (2250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:12:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.254s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a897272-eb9c-45ec-b90e-ee1417d9d118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15a1a7aa-e67c-4b24-a55c-83deea43782e', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a38a35-a7f8-4695-bee0-f8f0d6ff9f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:24 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Volume volume-15a1a7aa-e67c-4b24-a55c-83deea43782e (15a1a7aa-e67c-4b24-a55c-83deea43782e): created successfully Jul 08 01:12:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a38a35-a7f8-4695-bee0-f8f0d6ff9f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Flow 'volume_create_manager' (b09ec55f-2df8-45b2-8d2f-ceeb94d0be37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:12:24 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-d57a5fa6-6ed8-4c29-8396-8a308c61e494 tempest-AttachVolumeNegativeTest-54008946 None] Created volume successfully. Jul 08 01:12:25 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f706237b-a5c4-4a0e-96a6-f312dac8ab4b tempest-GroupsV314Test-1516875730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c39e4b55-359c-4b9e-9b08-ed117abd58c0" returned: 0 in 0.783s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f706237b-a5c4-4a0e-96a6-f312dac8ab4b tempest-GroupsV314Test-1516875730 None] Lock "cinder-quobyte-c39e4b55-359c-4b9e-9b08-ed117abd58c0" released by "delete_volume" :: held 2.056s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:25 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-f706237b-a5c4-4a0e-96a6-f312dac8ab4b tempest-GroupsV314Test-1516875730 None] Created reservations ['d9b96a4e-7d65-4cdc-afaa-8fb5deb48fb6'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:12:25 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-f706237b-a5c4-4a0e-96a6-f312dac8ab4b tempest-GroupsV314Test-1516875730 None] Created reservations ['883aad5e-a30b-4ad9-85cd-8a160a5a6c33', '00f82f68-f46e-4566-8fa5-d90f8c0f885d', 'bf3afbd5-2cd6-4cac-93e3-13c772897f97', 'fec421c9-0fbb-4594-be95-9b8c8f0a407e'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:12:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f706237b-a5c4-4a0e-96a6-f312dac8ab4b tempest-GroupsV314Test-1516875730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f706237b-a5c4-4a0e-96a6-f312dac8ab4b tempest-GroupsV314Test-1516875730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f706237b-a5c4-4a0e-96a6-f312dac8ab4b tempest-GroupsV314Test-1516875730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f706237b-a5c4-4a0e-96a6-f312dac8ab4b tempest-GroupsV314Test-1516875730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f706237b-a5c4-4a0e-96a6-f312dac8ab4b tempest-GroupsV314Test-1516875730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f706237b-a5c4-4a0e-96a6-f312dac8ab4b tempest-GroupsV314Test-1516875730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:25 devstack sudo[94748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:12:25 devstack sudo[94748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:26 devstack sudo[94748]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f706237b-a5c4-4a0e-96a6-f312dac8ab4b tempest-GroupsV314Test-1516875730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.825s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:26 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-f706237b-a5c4-4a0e-96a6-f312dac8ab4b tempest-GroupsV314Test-1516875730 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:12:26 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-f706237b-a5c4-4a0e-96a6-f312dac8ab4b tempest-GroupsV314Test-1516875730 None] Delete group completed successfully. Jul 08 01:12:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-fe954c41-4669-40fd-9e1d-dedc9ab8d2f2 req-ed34b70a-74b7-4fdf-b91a-fb665e5dc22e tempest-AttachVolumeTestJSON-1253782169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-fe954c41-4669-40fd-9e1d-dedc9ab8d2f2 req-ed34b70a-74b7-4fdf-b91a-fb665e5dc22e tempest-AttachVolumeTestJSON-1253782169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:26 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d791c5-27ff-42ed-9f7b-f310efa07c54]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-fe954c41-4669-40fd-9e1d-dedc9ab8d2f2 req-ed34b70a-74b7-4fdf-b91a-fb665e5dc22e tempest-AttachVolumeTestJSON-1253782169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a9f9870f-2660-4258-b63f-a7423f5ea693 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:27 devstack sudo[94765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a9f9870f-2660-4258-b63f-a7423f5ea693 Jul 08 01:12:27 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:27 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-fe954c41-4669-40fd-9e1d-dedc9ab8d2f2 req-ed34b70a-74b7-4fdf-b91a-fb665e5dc22e tempest-AttachVolumeTestJSON-1253782169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a9f9870f-2660-4258-b63f-a7423f5ea693" returned: 0 in 0.999s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-fe954c41-4669-40fd-9e1d-dedc9ab8d2f2 req-ed34b70a-74b7-4fdf-b91a-fb665e5dc22e tempest-AttachVolumeTestJSON-1253782169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.033s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:27 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:UPDATE=98,cinder:DELETE=6,cinder:SELECT=68,cinder:INSERT=18 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:12:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-fe954c41-4669-40fd-9e1d-dedc9ab8d2f2 req-ed34b70a-74b7-4fdf-b91a-fb665e5dc22e tempest-AttachVolumeTestJSON-1253782169 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d', 'name': 'volume-a9f9870f-2660-4258-b63f-a7423f5ea693', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c5644d1d-ea68-4385-b6a2-9d20c99d1c6e', 'enforce_multipath': True} {{(pid=87022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:12:28 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-fe954c41-4669-40fd-9e1d-dedc9ab8d2f2 req-ed34b70a-74b7-4fdf-b91a-fb665e5dc22e tempest-AttachVolumeTestJSON-1253782169 None] attachment_update completed successfully. Jul 08 01:12:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-29b09a3d-4c86-4e6a-86ab-478f3dd5bf98 req-9455bffc-b338-49eb-8743-d30028b1ad8f tempest-AttachVolumeNegativeTest-54008946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-29b09a3d-4c86-4e6a-86ab-478f3dd5bf98 req-9455bffc-b338-49eb-8743-d30028b1ad8f tempest-AttachVolumeNegativeTest-54008946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:29 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edb52d3-f6f8-43fa-bad5-a853ff41eed2]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-29b09a3d-4c86-4e6a-86ab-478f3dd5bf98 req-9455bffc-b338-49eb-8743-d30028b1ad8f tempest-AttachVolumeNegativeTest-54008946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-15a1a7aa-e67c-4b24-a55c-83deea43782e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:29 devstack sudo[94847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-15a1a7aa-e67c-4b24-a55c-83deea43782e Jul 08 01:12:29 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:30 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-29b09a3d-4c86-4e6a-86ab-478f3dd5bf98 req-9455bffc-b338-49eb-8743-d30028b1ad8f tempest-AttachVolumeNegativeTest-54008946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-15a1a7aa-e67c-4b24-a55c-83deea43782e" returned: 0 in 1.123s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-29b09a3d-4c86-4e6a-86ab-478f3dd5bf98 req-9455bffc-b338-49eb-8743-d30028b1ad8f tempest-AttachVolumeNegativeTest-54008946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.153s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-29b09a3d-4c86-4e6a-86ab-478f3dd5bf98 req-9455bffc-b338-49eb-8743-d30028b1ad8f tempest-AttachVolumeNegativeTest-54008946 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d', 'name': 'volume-15a1a7aa-e67c-4b24-a55c-83deea43782e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '83ba6d96-e44f-44b7-b7ee-f77cf5af2ed4', 'enforce_multipath': True} {{(pid=87022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:12:30 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-29b09a3d-4c86-4e6a-86ab-478f3dd5bf98 req-9455bffc-b338-49eb-8743-d30028b1ad8f tempest-AttachVolumeNegativeTest-54008946 None] attachment_update completed successfully. Jul 08 01:12:33 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:12:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Flow 'volume_create_manager' (83e989dc-89f5-4a28-90b5-f94683620b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:12:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed1c3a8b-8541-4e08-8536-49951248af07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed1c3a8b-8541-4e08-8536-49951248af07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-231592203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c92b41a8c8d44b81a54ec8b95273ca6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:12:34Z,use_quota=True,user_id='f9c3dd452069487a99049969dbb9ea6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d426d20-3e04-416e-8496-d42e9366260d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d426d20-3e04-416e-8496-d42e9366260d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6a4c88f-fa7c-4c12-847c-182922f4d875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6a4c88f-fa7c-4c12-847c-182922f4d875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0', 'volume_name': 'volume-9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744d3f3c-391f-46e3-bebe-8d851eb0feb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744d3f3c-391f-46e3-bebe-8d851eb0feb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af924d2d-4b33-4e3f-aab5-67cf12361725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:33 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Volume 9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0', 'volume_size': 1} Jul 08 01:12:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:33 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-231592203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c92b41a8c8d44b81a54ec8b95273ca6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:12:34Z,use_quota=True,user_id='f9c3dd452069487a99049969dbb9ea6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:12:33 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Creating volume 9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:12:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:33 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:33 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:33 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:12:33 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:12:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:33 devstack sudo[95169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0 1073741824 Jul 08 01:12:33 devstack sudo[95169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:34 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:12:34 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Flow 'volume_create_manager' (6bfebb71-0e0a-4aea-8316-398e9a98ca8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:12:34 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (126af411-2f64-4b2e-a185-0405f8dc8bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:34 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (126af411-2f64-4b2e-a185-0405f8dc8bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-676816957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab69977-3681-426e-b914-69acccb59304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d2abca83eb4c65a3e1a81a37da232f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:12:35Z,use_quota=True,user_id='df37bb49bd2c478fa9c9910490b08131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:34 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1e8ba03-fb12-43de-8720-c3d75abcf85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:34 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1e8ba03-fb12-43de-8720-c3d75abcf85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:34 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f243ad80-b037-445f-84c7-086f40aa908b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:34 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f243ad80-b037-445f-84c7-086f40aa908b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cab69977-3681-426e-b914-69acccb59304', 'volume_name': 'volume-cab69977-3681-426e-b914-69acccb59304', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:34 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b1ca57-1ff3-4488-a7f8-a2fa17aed67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:34 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b1ca57-1ff3-4488-a7f8-a2fa17aed67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:34 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43490790-4173-4134-9f49-2f22b4817152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:34 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Volume cab69977-3681-426e-b914-69acccb59304: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cab69977-3681-426e-b914-69acccb59304', 'volume_size': 1} Jul 08 01:12:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:34 devstack sudo[95169]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0 1073741824" returned: 0 in 1.174s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:35 devstack sudo[95174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0 Jul 08 01:12:35 devstack sudo[95174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:35 devstack sudo[95174]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0" returned: 0 in 0.934s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:35 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] <== create_volume: return (2162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:12:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.164s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.036s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:35 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-676816957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab69977-3681-426e-b914-69acccb59304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d2abca83eb4c65a3e1a81a37da232f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:12:35Z,use_quota=True,user_id='df37bb49bd2c478fa9c9910490b08131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:12:35 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Creating volume cab69977-3681-426e-b914-69acccb59304 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:12:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:35 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:35 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:35 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:12:35 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:12:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:35 devstack sudo[95178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304 1073741824 Jul 08 01:12:35 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:35 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af924d2d-4b33-4e3f-aab5-67cf12361725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:35 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8553e3a7-ebf3-4163-ac75-58f13a4c87ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:35 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Volume volume-9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0 (9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0): created successfully Jul 08 01:12:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8553e3a7-ebf3-4163-ac75-58f13a4c87ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Flow 'volume_create_manager' (83e989dc-89f5-4a28-90b5-f94683620b4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:12:36 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-bb590167-d213-4888-b4f9-81dfdd126925 tempest-AttachVolumeTestJSON-1253782169 None] Created volume successfully. Jul 08 01:12:37 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-898fa876-e6dc-474d-9290-bab6db85b738 req-db6bd149-d875-4ea0-8033-980087fc7041 tempest-AttachVolumeNegativeTest-54008946 None] Terminate volume connection completed successfully. Jul 08 01:12:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-898fa876-e6dc-474d-9290-bab6db85b738 req-db6bd149-d875-4ea0-8033-980087fc7041 tempest-AttachVolumeNegativeTest-54008946 None] Deleting attachment 83ba6d96-e44f-44b7-b7ee-f77cf5af2ed4. {{(pid=87022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:12:37 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304 1073741824" returned: 0 in 1.139s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:37 devstack sudo[95191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304 Jul 08 01:12:37 devstack sudo[95191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:37 devstack sudo[95191]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304" returned: 0 in 0.692s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:37 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:12:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.888s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43490790-4173-4134-9f49-2f22b4817152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cab69977-3681-426e-b914-69acccb59304', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdf740a5-7190-4758-bb81-795fc2044bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:37 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Volume volume-cab69977-3681-426e-b914-69acccb59304 (cab69977-3681-426e-b914-69acccb59304): created successfully Jul 08 01:12:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdf740a5-7190-4758-bb81-795fc2044bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Flow 'volume_create_manager' (6bfebb71-0e0a-4aea-8316-398e9a98ca8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:12:37 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-800cd2f9-c01a-4f70-9312-c8b8927cefae tempest-SnapshotsActionsTest-433556109 None] Created volume successfully. Jul 08 01:12:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4f225460-9dfd-4433-8eee-878bf46952bb tempest-SnapshotsActionsTest-433556109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4f225460-9dfd-4433-8eee-878bf46952bb tempest-SnapshotsActionsTest-433556109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-4f225460-9dfd-4433-8eee-878bf46952bb tempest-SnapshotsActionsTest-433556109 None] Creating offline snapshot c7611e9a-941f-4fd0-b7de-7c8774bb081a of volume cab69977-3681-426e-b914-69acccb59304 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:12:38 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[42642387-95f0-4152-9d13-09f3321a03ac]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4f225460-9dfd-4433-8eee-878bf46952bb tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:38 devstack sudo[95194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304 Jul 08 01:12:38 devstack sudo[95194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:38 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:12:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Flow 'volume_create_manager' (8c1e14e6-8268-4a7c-9acb-6b389f25508c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:12:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0333804e-f3c2-478c-baf5-44f23e629fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0333804e-f3c2-478c-baf5-44f23e629fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-504737395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba357599-0ae0-438f-8fb4-a71b7afaefa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7dc4a992f36455487c74907dbe27fa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:12:39Z,use_quota=True,user_id='edf06a8e9286452fa2c2e76a0db1fc6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed67c0d6-ba0b-4dc7-91fe-5f200ab09a84),volume_type_id=ed67c0d6-ba0b-4dc7-91fe-5f200ab09a84)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bccefd8-af56-4a44-90a6-672c206920f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bccefd8-af56-4a44-90a6-672c206920f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ed575c-297b-4398-bef3-1672ef51b9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ed575c-297b-4398-bef3-1672ef51b9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba357599-0ae0-438f-8fb4-a71b7afaefa5', 'volume_name': 'volume-ba357599-0ae0-438f-8fb4-a71b7afaefa5', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d494386c-e764-4051-ade8-dffe647df182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d494386c-e764-4051-ade8-dffe647df182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351761f2-d648-40eb-a61c-636bef6cd6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:39 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Volume ba357599-0ae0-438f-8fb4-a71b7afaefa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba357599-0ae0-438f-8fb4-a71b7afaefa5', 'volume_size': 1} Jul 08 01:12:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:39 devstack sudo[95194]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4f225460-9dfd-4433-8eee-878bf46952bb tempest-SnapshotsActionsTest-433556109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304" returned: 0 in 0.949s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4f225460-9dfd-4433-8eee-878bf46952bb tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:39 devstack sudo[95199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a 1G Jul 08 01:12:39 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-c8584162-8b2e-44ee-a72e-307af0d7dd73 req-953b4bf2-490d-4df3-8223-9a90cd0a1ade tempest-AttachVolumeTestJSON-1253782169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:40 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4f225460-9dfd-4433-8eee-878bf46952bb tempest-SnapshotsActionsTest-433556109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a 1G" returned: 0 in 1.086s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4f225460-9dfd-4433-8eee-878bf46952bb tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cab69977-3681-426e-b914-69acccb59304 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:40 devstack sudo[95213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cab69977-3681-426e-b914-69acccb59304 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a Jul 08 01:12:40 devstack sudo[95213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:41 devstack sudo[95213]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4f225460-9dfd-4433-8eee-878bf46952bb tempest-SnapshotsActionsTest-433556109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cab69977-3681-426e-b914-69acccb59304 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a" returned: 0 in 0.718s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:41 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-4f225460-9dfd-4433-8eee-878bf46952bb tempest-SnapshotsActionsTest-433556109 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a is being set with open permissions: ugo+rw Jul 08 01:12:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4f225460-9dfd-4433-8eee-878bf46952bb tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:41 devstack sudo[95223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a Jul 08 01:12:41 devstack sudo[95223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:41 devstack sudo[95223]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4f225460-9dfd-4433-8eee-878bf46952bb tempest-SnapshotsActionsTest-433556109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a" returned: 0 in 0.797s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4f225460-9dfd-4433-8eee-878bf46952bb tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:41 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.info Jul 08 01:12:41 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:42 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4f225460-9dfd-4433-8eee-878bf46952bb tempest-SnapshotsActionsTest-433556109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.info" returned: 0 in 0.750s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:42 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-4f225460-9dfd-4433-8eee-878bf46952bb tempest-SnapshotsActionsTest-433556109 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.info is being set with open permissions: ugo+rw Jul 08 01:12:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4f225460-9dfd-4433-8eee-878bf46952bb tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:42 devstack sudo[95246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.info Jul 08 01:12:42 devstack sudo[95246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:43 devstack sudo[95246]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4f225460-9dfd-4433-8eee-878bf46952bb tempest-SnapshotsActionsTest-433556109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.info" returned: 0 in 0.757s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4f225460-9dfd-4433-8eee-878bf46952bb tempest-SnapshotsActionsTest-433556109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.160s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.359s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:43 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-504737395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba357599-0ae0-438f-8fb4-a71b7afaefa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7dc4a992f36455487c74907dbe27fa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:12:39Z,use_quota=True,user_id='edf06a8e9286452fa2c2e76a0db1fc6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed67c0d6-ba0b-4dc7-91fe-5f200ab09a84),volume_type_id=ed67c0d6-ba0b-4dc7-91fe-5f200ab09a84)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:12:43 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Creating volume ba357599-0ae0-438f-8fb4-a71b7afaefa5 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:12:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:43 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:43 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:43 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:12:43 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:12:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ba357599-0ae0-438f-8fb4-a71b7afaefa5 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:43 devstack sudo[95251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ba357599-0ae0-438f-8fb4-a71b7afaefa5 1073741824 Jul 08 01:12:43 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:43 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-4f225460-9dfd-4433-8eee-878bf46952bb tempest-SnapshotsActionsTest-433556109 None] Create snapshot completed successfully Jul 08 01:12:44 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ba357599-0ae0-438f-8fb4-a71b7afaefa5 1073741824" returned: 0 in 0.866s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ba357599-0ae0-438f-8fb4-a71b7afaefa5 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:44 devstack sudo[95256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ba357599-0ae0-438f-8fb4-a71b7afaefa5 Jul 08 01:12:44 devstack sudo[95256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:45 devstack sudo[95256]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ba357599-0ae0-438f-8fb4-a71b7afaefa5" returned: 0 in 0.771s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:12:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-c8584162-8b2e-44ee-a72e-307af0d7dd73 req-953b4bf2-490d-4df3-8223-9a90cd0a1ade tempest-AttachVolumeTestJSON-1253782169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.141s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351761f2-d648-40eb-a61c-636bef6cd6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba357599-0ae0-438f-8fb4-a71b7afaefa5', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bbcf4f7-aa53-4e7b-9869-65e168f02f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:45 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa7e3b2-884a-4274-8432-830db069e770]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-c8584162-8b2e-44ee-a72e-307af0d7dd73 req-953b4bf2-490d-4df3-8223-9a90cd0a1ade tempest-AttachVolumeTestJSON-1253782169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:45 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Volume volume-ba357599-0ae0-438f-8fb4-a71b7afaefa5 (ba357599-0ae0-438f-8fb4-a71b7afaefa5): created successfully Jul 08 01:12:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bbcf4f7-aa53-4e7b-9869-65e168f02f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Flow 'volume_create_manager' (8c1e14e6-8268-4a7c-9acb-6b389f25508c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:12:45 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-5cb21e6e-19f7-4b01-98ec-78701510f823 tempest-VolumeTypesAccessTest-965848122 None] Created volume successfully. Jul 08 01:12:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-65d1d7b6-5a2e-4ffc-8011-bd2f844905c4 tempest-SnapshotsActionsTest-433556109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:45 devstack sudo[95259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0 Jul 08 01:12:45 devstack sudo[95259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:45 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:12:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:45 devstack sudo[95261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:12:45 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:45 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0bbd0db1-a9ff-4e19-8357-c4482295dafc tempest-VolumeTypesAccessTest-965848122 None] Acquiring lock "cinder-ba357599-0ae0-438f-8fb4-a71b7afaefa5-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:45 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0bbd0db1-a9ff-4e19-8357-c4482295dafc tempest-VolumeTypesAccessTest-965848122 None] Lock "cinder-ba357599-0ae0-438f-8fb4-a71b7afaefa5-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:45 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0bbd0db1-a9ff-4e19-8357-c4482295dafc tempest-VolumeTypesAccessTest-965848122 None] Acquiring lock "cinder-quobyte-ba357599-0ae0-438f-8fb4-a71b7afaefa5" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:45 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0bbd0db1-a9ff-4e19-8357-c4482295dafc tempest-VolumeTypesAccessTest-965848122 None] Lock "cinder-quobyte-ba357599-0ae0-438f-8fb4-a71b7afaefa5" acquired by "delete_volume" :: waited 0.024s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:45 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ac8997-a9b6-4847-9f03-b4d773d7868f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0bbd0db1-a9ff-4e19-8357-c4482295dafc tempest-VolumeTypesAccessTest-965848122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ba357599-0ae0-438f-8fb4-a71b7afaefa5 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:45 devstack sudo[95263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ba357599-0ae0-438f-8fb4-a71b7afaefa5 Jul 08 01:12:45 devstack sudo[95263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:46 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.851s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:46 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:12:46 devstack sudo[95259]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-c8584162-8b2e-44ee-a72e-307af0d7dd73 req-953b4bf2-490d-4df3-8223-9a90cd0a1ade tempest-AttachVolumeTestJSON-1253782169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0" returned: 0 in 1.109s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-c8584162-8b2e-44ee-a72e-307af0d7dd73 req-953b4bf2-490d-4df3-8223-9a90cd0a1ade tempest-AttachVolumeTestJSON-1253782169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.146s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-65d1d7b6-5a2e-4ffc-8011-bd2f844905c4 tempest-SnapshotsActionsTest-433556109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.025s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:46 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:12:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread count: 8 {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:12:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread info: [<_MainThread(MainThread, started 134382216167552)>, , , , , , , ] {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:12:46 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-65d1d7b6-5a2e-4ffc-8011-bd2f844905c4 tempest-SnapshotsActionsTest-433556109 None] Creating offline snapshot f93a4f7e-28de-4a36-950a-a6f5e41bcb9a of volume cab69977-3681-426e-b914-69acccb59304 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:12:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-c8584162-8b2e-44ee-a72e-307af0d7dd73 req-953b4bf2-490d-4df3-8223-9a90cd0a1ade tempest-AttachVolumeTestJSON-1253782169 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d', 'name': 'volume-9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd220b6c9-4df8-4f01-94ce-0d25320c73ae', 'enforce_multipath': True} {{(pid=87022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:12:46 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d677cd7e-f21b-4a44-a3c9-bebf01d9dfc7]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-65d1d7b6-5a2e-4ffc-8011-bd2f844905c4 tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:46 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-c8584162-8b2e-44ee-a72e-307af0d7dd73 req-953b4bf2-490d-4df3-8223-9a90cd0a1ade tempest-AttachVolumeTestJSON-1253782169 None] attachment_update completed successfully. Jul 08 01:12:46 devstack sudo[95269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a Jul 08 01:12:46 devstack sudo[95269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:46 devstack sudo[95263]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0bbd0db1-a9ff-4e19-8357-c4482295dafc tempest-VolumeTypesAccessTest-965848122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ba357599-0ae0-438f-8fb4-a71b7afaefa5" returned: 0 in 1.108s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0bbd0db1-a9ff-4e19-8357-c4482295dafc tempest-VolumeTypesAccessTest-965848122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ba357599-0ae0-438f-8fb4-a71b7afaefa5 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:46 devstack sudo[95274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ba357599-0ae0-438f-8fb4-a71b7afaefa5 Jul 08 01:12:46 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:47 devstack sudo[95269]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-65d1d7b6-5a2e-4ffc-8011-bd2f844905c4 tempest-SnapshotsActionsTest-433556109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a" returned: 0 in 1.163s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:47 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-65d1d7b6-5a2e-4ffc-8011-bd2f844905c4 tempest-SnapshotsActionsTest-433556109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cab69977-3681-426e-b914-69acccb59304(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:12:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-65d1d7b6-5a2e-4ffc-8011-bd2f844905c4 tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.f93a4f7e-28de-4a36-950a-a6f5e41bcb9a 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:47 devstack sudo[95284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.f93a4f7e-28de-4a36-950a-a6f5e41bcb9a 1G Jul 08 01:12:47 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:47 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0bbd0db1-a9ff-4e19-8357-c4482295dafc tempest-VolumeTypesAccessTest-965848122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ba357599-0ae0-438f-8fb4-a71b7afaefa5" returned: 0 in 0.863s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:47 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0bbd0db1-a9ff-4e19-8357-c4482295dafc tempest-VolumeTypesAccessTest-965848122 None] Lock "cinder-quobyte-ba357599-0ae0-438f-8fb4-a71b7afaefa5" released by "delete_volume" :: held 2.031s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:47 devstack cinder-volume[87022]: WARNING cinder.quota [None req-0bbd0db1-a9ff-4e19-8357-c4482295dafc tempest-VolumeTypesAccessTest-965848122 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2051620165 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2051620165, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:12:47 devstack cinder-volume[87022]: WARNING cinder.quota [None req-0bbd0db1-a9ff-4e19-8357-c4482295dafc tempest-VolumeTypesAccessTest-965848122 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2051620165 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2051620165, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:12:47 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-0bbd0db1-a9ff-4e19-8357-c4482295dafc tempest-VolumeTypesAccessTest-965848122 None] Created reservations ['2125c2e2-beb8-44ed-8c69-901deb16b515', '442bc8e3-05cf-4818-bc2a-cffd79ad7ebc', '44599c41-ccfb-429d-84a6-58506c1730c8', '39dcdbd4-c27b-4cff-906b-5b862e365d2d'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:12:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-0bbd0db1-a9ff-4e19-8357-c4482295dafc tempest-VolumeTypesAccessTest-965848122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-0bbd0db1-a9ff-4e19-8357-c4482295dafc tempest-VolumeTypesAccessTest-965848122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:47 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-0bbd0db1-a9ff-4e19-8357-c4482295dafc tempest-VolumeTypesAccessTest-965848122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:47 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-0bbd0db1-a9ff-4e19-8357-c4482295dafc tempest-VolumeTypesAccessTest-965848122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-0bbd0db1-a9ff-4e19-8357-c4482295dafc tempest-VolumeTypesAccessTest-965848122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0bbd0db1-a9ff-4e19-8357-c4482295dafc tempest-VolumeTypesAccessTest-965848122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:47 devstack sudo[95286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:12:47 devstack sudo[95286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:48 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a07854a4-f9b6-4bd3-9f36-954e0bfcac0b tempest-AttachVolumeNegativeTest-54008946 None] Acquiring lock "cinder-15a1a7aa-e67c-4b24-a55c-83deea43782e-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:48 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a07854a4-f9b6-4bd3-9f36-954e0bfcac0b tempest-AttachVolumeNegativeTest-54008946 None] Lock "cinder-15a1a7aa-e67c-4b24-a55c-83deea43782e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:48 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a07854a4-f9b6-4bd3-9f36-954e0bfcac0b tempest-AttachVolumeNegativeTest-54008946 None] Acquiring lock "cinder-quobyte-15a1a7aa-e67c-4b24-a55c-83deea43782e" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:48 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a07854a4-f9b6-4bd3-9f36-954e0bfcac0b tempest-AttachVolumeNegativeTest-54008946 None] Lock "cinder-quobyte-15a1a7aa-e67c-4b24-a55c-83deea43782e" acquired by "delete_volume" :: waited 0.031s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:48 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[152e519b-9d17-45ce-b02e-86e64bd440e3]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a07854a4-f9b6-4bd3-9f36-954e0bfcac0b tempest-AttachVolumeNegativeTest-54008946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-15a1a7aa-e67c-4b24-a55c-83deea43782e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:48 devstack sudo[95288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-15a1a7aa-e67c-4b24-a55c-83deea43782e Jul 08 01:12:48 devstack sudo[95288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:48 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-65d1d7b6-5a2e-4ffc-8011-bd2f844905c4 tempest-SnapshotsActionsTest-433556109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.f93a4f7e-28de-4a36-950a-a6f5e41bcb9a 1G" returned: 0 in 1.133s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-65d1d7b6-5a2e-4ffc-8011-bd2f844905c4 tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.f93a4f7e-28de-4a36-950a-a6f5e41bcb9a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:48 devstack sudo[95319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.f93a4f7e-28de-4a36-950a-a6f5e41bcb9a Jul 08 01:12:48 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:48 devstack sudo[95286]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0bbd0db1-a9ff-4e19-8357-c4482295dafc tempest-VolumeTypesAccessTest-965848122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.897s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:48 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-0bbd0db1-a9ff-4e19-8357-c4482295dafc tempest-VolumeTypesAccessTest-965848122 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:12:48 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-0bbd0db1-a9ff-4e19-8357-c4482295dafc tempest-VolumeTypesAccessTest-965848122 None] Deleted volume successfully. Jul 08 01:12:48 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0bbd0db1-a9ff-4e19-8357-c4482295dafc tempest-VolumeTypesAccessTest-965848122 None] Lock "cinder-ba357599-0ae0-438f-8fb4-a71b7afaefa5-delete_volume" released by "delete_volume" :: held 3.317s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:49 devstack sudo[95288]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a07854a4-f9b6-4bd3-9f36-954e0bfcac0b tempest-AttachVolumeNegativeTest-54008946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-15a1a7aa-e67c-4b24-a55c-83deea43782e" returned: 0 in 0.925s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a07854a4-f9b6-4bd3-9f36-954e0bfcac0b tempest-AttachVolumeNegativeTest-54008946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-15a1a7aa-e67c-4b24-a55c-83deea43782e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:49 devstack sudo[95325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-15a1a7aa-e67c-4b24-a55c-83deea43782e Jul 08 01:12:49 devstack sudo[95325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:49 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-65d1d7b6-5a2e-4ffc-8011-bd2f844905c4 tempest-SnapshotsActionsTest-433556109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.f93a4f7e-28de-4a36-950a-a6f5e41bcb9a" returned: 0 in 1.052s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:49 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-65d1d7b6-5a2e-4ffc-8011-bd2f844905c4 tempest-SnapshotsActionsTest-433556109 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.f93a4f7e-28de-4a36-950a-a6f5e41bcb9a is being set with open permissions: ugo+rw Jul 08 01:12:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-65d1d7b6-5a2e-4ffc-8011-bd2f844905c4 tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.f93a4f7e-28de-4a36-950a-a6f5e41bcb9a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:49 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.f93a4f7e-28de-4a36-950a-a6f5e41bcb9a Jul 08 01:12:49 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:49 devstack sudo[95325]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a07854a4-f9b6-4bd3-9f36-954e0bfcac0b tempest-AttachVolumeNegativeTest-54008946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-15a1a7aa-e67c-4b24-a55c-83deea43782e" returned: 0 in 0.879s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:49 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a07854a4-f9b6-4bd3-9f36-954e0bfcac0b tempest-AttachVolumeNegativeTest-54008946 None] Lock "cinder-quobyte-15a1a7aa-e67c-4b24-a55c-83deea43782e" released by "delete_volume" :: held 1.864s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:50 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-a07854a4-f9b6-4bd3-9f36-954e0bfcac0b tempest-AttachVolumeNegativeTest-54008946 None] Created reservations ['352c44ac-c710-44ae-b3f0-d02de4e48e04', 'ad69f986-382d-4075-9861-ac1fdc07291f', 'fa5bf36a-1bdc-4583-887a-5b7e46d24ed4', 'f82f8159-a6ee-4f4c-8330-c185f99ae5c4'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:12:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a07854a4-f9b6-4bd3-9f36-954e0bfcac0b tempest-AttachVolumeNegativeTest-54008946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a07854a4-f9b6-4bd3-9f36-954e0bfcac0b tempest-AttachVolumeNegativeTest-54008946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:50 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a07854a4-f9b6-4bd3-9f36-954e0bfcac0b tempest-AttachVolumeNegativeTest-54008946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:50 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a07854a4-f9b6-4bd3-9f36-954e0bfcac0b tempest-AttachVolumeNegativeTest-54008946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a07854a4-f9b6-4bd3-9f36-954e0bfcac0b tempest-AttachVolumeNegativeTest-54008946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a07854a4-f9b6-4bd3-9f36-954e0bfcac0b tempest-AttachVolumeNegativeTest-54008946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:50 devstack sudo[95333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:12:50 devstack sudo[95333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-95fee1e9-d10d-4712-a508-e3b431785601 tempest-AttachVolumeNegativeTest-54008946 None] Acquiring lock "cinder-bf381580-5040-4628-95fa-6727b5bad524-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-95fee1e9-d10d-4712-a508-e3b431785601 tempest-AttachVolumeNegativeTest-54008946 None] Lock "cinder-bf381580-5040-4628-95fa-6727b5bad524-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:50 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-65d1d7b6-5a2e-4ffc-8011-bd2f844905c4 tempest-SnapshotsActionsTest-433556109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.f93a4f7e-28de-4a36-950a-a6f5e41bcb9a" returned: 0 in 1.001s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-65d1d7b6-5a2e-4ffc-8011-bd2f844905c4 tempest-SnapshotsActionsTest-433556109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.494s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:51 devstack sudo[95333]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a07854a4-f9b6-4bd3-9f36-954e0bfcac0b tempest-AttachVolumeNegativeTest-54008946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.892s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:51 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-a07854a4-f9b6-4bd3-9f36-954e0bfcac0b tempest-AttachVolumeNegativeTest-54008946 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:12:51 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-a07854a4-f9b6-4bd3-9f36-954e0bfcac0b tempest-AttachVolumeNegativeTest-54008946 None] Deleted volume successfully. Jul 08 01:12:51 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-95fee1e9-d10d-4712-a508-e3b431785601 tempest-AttachVolumeNegativeTest-54008946 None] Acquiring lock "cinder-quobyte-bf381580-5040-4628-95fa-6727b5bad524" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:51 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-95fee1e9-d10d-4712-a508-e3b431785601 tempest-AttachVolumeNegativeTest-54008946 None] Lock "cinder-quobyte-bf381580-5040-4628-95fa-6727b5bad524" acquired by "delete_volume" :: waited 0.023s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:51 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbb6beb-e7dc-4143-aef1-b052bd027d1a]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-95fee1e9-d10d-4712-a508-e3b431785601 tempest-AttachVolumeNegativeTest-54008946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bf381580-5040-4628-95fa-6727b5bad524 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:51 devstack sudo[95340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bf381580-5040-4628-95fa-6727b5bad524 Jul 08 01:12:51 devstack sudo[95340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:51 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-65d1d7b6-5a2e-4ffc-8011-bd2f844905c4 tempest-SnapshotsActionsTest-433556109 None] Create snapshot completed successfully Jul 08 01:12:52 devstack sudo[95340]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-95fee1e9-d10d-4712-a508-e3b431785601 tempest-AttachVolumeNegativeTest-54008946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bf381580-5040-4628-95fa-6727b5bad524" returned: 0 in 0.886s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-95fee1e9-d10d-4712-a508-e3b431785601 tempest-AttachVolumeNegativeTest-54008946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bf381580-5040-4628-95fa-6727b5bad524 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:52 devstack sudo[95345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bf381580-5040-4628-95fa-6727b5bad524 Jul 08 01:12:52 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:52 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a07854a4-f9b6-4bd3-9f36-954e0bfcac0b tempest-AttachVolumeNegativeTest-54008946 None] Lock "cinder-15a1a7aa-e67c-4b24-a55c-83deea43782e-delete_volume" released by "delete_volume" :: held 4.062s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:52 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-95fee1e9-d10d-4712-a508-e3b431785601 tempest-AttachVolumeNegativeTest-54008946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bf381580-5040-4628-95fa-6727b5bad524" returned: 0 in 0.710s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:52 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-95fee1e9-d10d-4712-a508-e3b431785601 tempest-AttachVolumeNegativeTest-54008946 None] Lock "cinder-quobyte-bf381580-5040-4628-95fa-6727b5bad524" released by "delete_volume" :: held 1.646s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:55 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-95fee1e9-d10d-4712-a508-e3b431785601 tempest-AttachVolumeNegativeTest-54008946 None] Created reservations ['0c45c3c9-6acc-478b-aca8-d6aa324003a2', '4f636268-f25a-4a1a-a5b4-a2dbdfc35e6b', '8fdf3bae-fc31-4879-9aca-2884bcc7e4c7', '2bec3757-d2d8-4cfa-a004-cfdc674f2b54'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:12:55 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-224c5d85-2a4a-47f4-992d-673faf68431d tempest-SnapshotsActionsTest-960723725 None] Acquiring lock "cinder-f93a4f7e-28de-4a36-950a-a6f5e41bcb9a-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:55 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-224c5d85-2a4a-47f4-992d-673faf68431d tempest-SnapshotsActionsTest-960723725 None] Lock "cinder-f93a4f7e-28de-4a36-950a-a6f5e41bcb9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:55 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-224c5d85-2a4a-47f4-992d-673faf68431d tempest-SnapshotsActionsTest-960723725 None] Acquiring lock "cinder-quobyte-cab69977-3681-426e-b914-69acccb59304" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-224c5d85-2a4a-47f4-992d-673faf68431d tempest-SnapshotsActionsTest-960723725 None] Lock "cinder-quobyte-cab69977-3681-426e-b914-69acccb59304" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-224c5d85-2a4a-47f4-992d-673faf68431d tempest-SnapshotsActionsTest-960723725 None] Acquiring lock "cinder-quobyte-f93a4f7e-28de-4a36-950a-a6f5e41bcb9a" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-224c5d85-2a4a-47f4-992d-673faf68431d tempest-SnapshotsActionsTest-960723725 None] Lock "cinder-quobyte-f93a4f7e-28de-4a36-950a-a6f5e41bcb9a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:56 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-224c5d85-2a4a-47f4-992d-673faf68431d tempest-SnapshotsActionsTest-960723725 None] Deleting offline snapshot f93a4f7e-28de-4a36-950a-a6f5e41bcb9a of volume cab69977-3681-426e-b914-69acccb59304 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:12:56 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-224c5d85-2a4a-47f4-992d-673faf68431d tempest-SnapshotsActionsTest-960723725 None] snapshot_file for this snap is: volume-cab69977-3681-426e-b914-69acccb59304.f93a4f7e-28de-4a36-950a-a6f5e41bcb9a {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:12:56 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4088e0a0-47ca-46c7-915c-111440dce6d7]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-224c5d85-2a4a-47f4-992d-673faf68431d tempest-SnapshotsActionsTest-960723725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.f93a4f7e-28de-4a36-950a-a6f5e41bcb9a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:56 devstack sudo[95348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.f93a4f7e-28de-4a36-950a-a6f5e41bcb9a Jul 08 01:12:56 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-95fee1e9-d10d-4712-a508-e3b431785601 tempest-AttachVolumeNegativeTest-54008946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-95fee1e9-d10d-4712-a508-e3b431785601 tempest-AttachVolumeNegativeTest-54008946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:56 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-95fee1e9-d10d-4712-a508-e3b431785601 tempest-AttachVolumeNegativeTest-54008946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:56 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-95fee1e9-d10d-4712-a508-e3b431785601 tempest-AttachVolumeNegativeTest-54008946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-95fee1e9-d10d-4712-a508-e3b431785601 tempest-AttachVolumeNegativeTest-54008946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-95fee1e9-d10d-4712-a508-e3b431785601 tempest-AttachVolumeNegativeTest-54008946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:56 devstack sudo[95350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:12:56 devstack sudo[95350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:57 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-224c5d85-2a4a-47f4-992d-673faf68431d tempest-SnapshotsActionsTest-960723725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.f93a4f7e-28de-4a36-950a-a6f5e41bcb9a" returned: 0 in 1.074s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:57 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-224c5d85-2a4a-47f4-992d-673faf68431d tempest-SnapshotsActionsTest-960723725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cab69977-3681-426e-b914-69acccb59304(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:12:57 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-067b6e98-97e9-453e-8f3a-d11b4d7f2081 tempest-AttachVolumeNegativeTest-54008946 None] Acquiring lock "cinder-4d8800f9-49f1-49f5-86c2-fb96f97db74f-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:57 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cff7d64-f9e8-4273-a373-e41c116afaf7]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-224c5d85-2a4a-47f4-992d-673faf68431d tempest-SnapshotsActionsTest-960723725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:57 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-067b6e98-97e9-453e-8f3a-d11b4d7f2081 tempest-AttachVolumeNegativeTest-54008946 None] Lock "cinder-4d8800f9-49f1-49f5-86c2-fb96f97db74f-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:57 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-067b6e98-97e9-453e-8f3a-d11b4d7f2081 tempest-AttachVolumeNegativeTest-54008946 None] Acquiring lock "cinder-quobyte-4d8800f9-49f1-49f5-86c2-fb96f97db74f" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:57 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-067b6e98-97e9-453e-8f3a-d11b4d7f2081 tempest-AttachVolumeNegativeTest-54008946 None] Lock "cinder-quobyte-4d8800f9-49f1-49f5-86c2-fb96f97db74f" acquired by "delete_volume" :: waited 0.038s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:57 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a Jul 08 01:12:57 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[543d9722-243c-42db-aa1c-416a6187fcd3]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:57 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-067b6e98-97e9-453e-8f3a-d11b4d7f2081 tempest-AttachVolumeNegativeTest-54008946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4d8800f9-49f1-49f5-86c2-fb96f97db74f {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:57 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-091a8535-7d59-478c-a294-051ab1e476f8 req-fb984e30-18ee-4bd2-b5da-afc525aa409a tempest-AttachVolumeTestJSON-1253782169 None] Terminate volume connection completed successfully. Jul 08 01:12:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-091a8535-7d59-478c-a294-051ab1e476f8 req-fb984e30-18ee-4bd2-b5da-afc525aa409a tempest-AttachVolumeTestJSON-1253782169 None] Deleting attachment c5644d1d-ea68-4385-b6a2-9d20c99d1c6e. {{(pid=87022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:12:57 devstack sudo[95360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4d8800f9-49f1-49f5-86c2-fb96f97db74f Jul 08 01:12:57 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:57 devstack sudo[95350]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-95fee1e9-d10d-4712-a508-e3b431785601 tempest-AttachVolumeNegativeTest-54008946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.000s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:57 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-95fee1e9-d10d-4712-a508-e3b431785601 tempest-AttachVolumeNegativeTest-54008946 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:12:57 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-95fee1e9-d10d-4712-a508-e3b431785601 tempest-AttachVolumeNegativeTest-54008946 None] Deleted volume successfully. Jul 08 01:12:57 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-95fee1e9-d10d-4712-a508-e3b431785601 tempest-AttachVolumeNegativeTest-54008946 None] Lock "cinder-bf381580-5040-4628-95fa-6727b5bad524-delete_volume" released by "delete_volume" :: held 7.205s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:58 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-224c5d85-2a4a-47f4-992d-673faf68431d tempest-SnapshotsActionsTest-960723725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a" returned: 0 in 1.141s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-224c5d85-2a4a-47f4-992d-673faf68431d tempest-SnapshotsActionsTest-960723725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cab69977-3681-426e-b914-69acccb59304(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:12:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-224c5d85-2a4a-47f4-992d-673faf68431d tempest-SnapshotsActionsTest-960723725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.f93a4f7e-28de-4a36-950a-a6f5e41bcb9a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:58 devstack sudo[95369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.f93a4f7e-28de-4a36-950a-a6f5e41bcb9a Jul 08 01:12:58 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:58 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-067b6e98-97e9-453e-8f3a-d11b4d7f2081 tempest-AttachVolumeNegativeTest-54008946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4d8800f9-49f1-49f5-86c2-fb96f97db74f" returned: 0 in 1.036s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-067b6e98-97e9-453e-8f3a-d11b4d7f2081 tempest-AttachVolumeNegativeTest-54008946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4d8800f9-49f1-49f5-86c2-fb96f97db74f {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:58 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4d8800f9-49f1-49f5-86c2-fb96f97db74f Jul 08 01:12:58 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:59 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-067b6e98-97e9-453e-8f3a-d11b4d7f2081 tempest-AttachVolumeNegativeTest-54008946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4d8800f9-49f1-49f5-86c2-fb96f97db74f" returned: 0 in 0.843s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:59 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-067b6e98-97e9-453e-8f3a-d11b4d7f2081 tempest-AttachVolumeNegativeTest-54008946 None] Lock "cinder-quobyte-4d8800f9-49f1-49f5-86c2-fb96f97db74f" released by "delete_volume" :: held 1.944s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:59 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-067b6e98-97e9-453e-8f3a-d11b4d7f2081 tempest-AttachVolumeNegativeTest-54008946 None] Created reservations ['4104bc90-3933-494c-b7e1-c3724d1d9d65', '7d6708da-2b56-42f5-9eab-dca8d92e5885', '46f551ee-4943-4d0a-90c8-fde8b813dcc8', 'cea27d70-97c3-4286-9e11-afc27b84e2e2'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:12:59 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-224c5d85-2a4a-47f4-992d-673faf68431d tempest-SnapshotsActionsTest-960723725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.f93a4f7e-28de-4a36-950a-a6f5e41bcb9a" returned: 0 in 1.051s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-224c5d85-2a4a-47f4-992d-673faf68431d tempest-SnapshotsActionsTest-960723725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.f93a4f7e-28de-4a36-950a-a6f5e41bcb9a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:59 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.f93a4f7e-28de-4a36-950a-a6f5e41bcb9a Jul 08 01:12:59 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-067b6e98-97e9-453e-8f3a-d11b4d7f2081 tempest-AttachVolumeNegativeTest-54008946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-067b6e98-97e9-453e-8f3a-d11b4d7f2081 tempest-AttachVolumeNegativeTest-54008946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-067b6e98-97e9-453e-8f3a-d11b4d7f2081 tempest-AttachVolumeNegativeTest-54008946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-067b6e98-97e9-453e-8f3a-d11b4d7f2081 tempest-AttachVolumeNegativeTest-54008946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-067b6e98-97e9-453e-8f3a-d11b4d7f2081 tempest-AttachVolumeNegativeTest-54008946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-067b6e98-97e9-453e-8f3a-d11b4d7f2081 tempest-AttachVolumeNegativeTest-54008946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:59 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:12:59 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:00 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-d4df33a8-ca71-499f-9304-b3bcd36f65e7 req-3080a0cf-4c64-4392-958c-366df3311afa tempest-AttachVolumeTestJSON-1253782169 None] Terminate volume connection completed successfully. Jul 08 01:13:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-d4df33a8-ca71-499f-9304-b3bcd36f65e7 req-3080a0cf-4c64-4392-958c-366df3311afa tempest-AttachVolumeTestJSON-1253782169 None] Deleting attachment d220b6c9-4df8-4f01-94ce-0d25320c73ae. {{(pid=87022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:13:00 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-224c5d85-2a4a-47f4-992d-673faf68431d tempest-SnapshotsActionsTest-960723725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.f93a4f7e-28de-4a36-950a-a6f5e41bcb9a" returned: 0 in 0.929s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:00 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-224c5d85-2a4a-47f4-992d-673faf68431d tempest-SnapshotsActionsTest-960723725 None] Lock "cinder-quobyte-f93a4f7e-28de-4a36-950a-a6f5e41bcb9a" released by "_delete_snapshot" :: held 4.341s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:00 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-224c5d85-2a4a-47f4-992d-673faf68431d tempest-SnapshotsActionsTest-960723725 None] Lock "cinder-quobyte-cab69977-3681-426e-b914-69acccb59304" released by "delete_snapshot" :: held 4.364s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:00 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-067b6e98-97e9-453e-8f3a-d11b4d7f2081 tempest-AttachVolumeNegativeTest-54008946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.933s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:00 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-067b6e98-97e9-453e-8f3a-d11b4d7f2081 tempest-AttachVolumeNegativeTest-54008946 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:13:00 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-067b6e98-97e9-453e-8f3a-d11b4d7f2081 tempest-AttachVolumeNegativeTest-54008946 None] Deleted volume successfully. Jul 08 01:13:00 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-224c5d85-2a4a-47f4-992d-673faf68431d tempest-SnapshotsActionsTest-960723725 None] Created reservations ['bcb6b656-b739-4540-9bb5-f7d515234a9b', 'b81c58f0-7d84-4f44-a975-059894ad157d', '51ba1adc-b550-4f1f-91be-87c18aff543c', '85ce9d8f-c1ee-4418-8fc9-10a755c9ba22'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:13:00 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-067b6e98-97e9-453e-8f3a-d11b4d7f2081 tempest-AttachVolumeNegativeTest-54008946 None] Lock "cinder-4d8800f9-49f1-49f5-86c2-fb96f97db74f-delete_volume" released by "delete_volume" :: held 3.217s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:00 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-224c5d85-2a4a-47f4-992d-673faf68431d tempest-SnapshotsActionsTest-960723725 None] Delete snapshot completed successfully. Jul 08 01:13:00 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-224c5d85-2a4a-47f4-992d-673faf68431d tempest-SnapshotsActionsTest-960723725 None] Lock "cinder-f93a4f7e-28de-4a36-950a-a6f5e41bcb9a-delete_snapshot" released by "delete_snapshot" :: held 4.569s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:01 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=94,cinder:UPDATE=93,cinder:INSERT=25,cinder:DELETE=5 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:13:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a4c3e338-6978-41ce-8bdd-351b9b80954c tempest-SnapshotsActionsTest-433556109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a4c3e338-6978-41ce-8bdd-351b9b80954c tempest-SnapshotsActionsTest-433556109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-a4c3e338-6978-41ce-8bdd-351b9b80954c tempest-SnapshotsActionsTest-433556109 None] Creating offline snapshot 4d5abbd8-11ea-4862-9b14-759e09c2142d of volume cab69977-3681-426e-b914-69acccb59304 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:13:01 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4c97b9-1825-4ae3-a512-c8995965bbf0]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a4c3e338-6978-41ce-8bdd-351b9b80954c tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:02 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a Jul 08 01:13:02 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:03 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a4c3e338-6978-41ce-8bdd-351b9b80954c tempest-SnapshotsActionsTest-433556109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a" returned: 0 in 1.175s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:03 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-a4c3e338-6978-41ce-8bdd-351b9b80954c tempest-SnapshotsActionsTest-433556109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cab69977-3681-426e-b914-69acccb59304(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:13:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a4c3e338-6978-41ce-8bdd-351b9b80954c tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.4d5abbd8-11ea-4862-9b14-759e09c2142d 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:03 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.4d5abbd8-11ea-4862-9b14-759e09c2142d 1G Jul 08 01:13:03 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:04 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a4c3e338-6978-41ce-8bdd-351b9b80954c tempest-SnapshotsActionsTest-433556109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.4d5abbd8-11ea-4862-9b14-759e09c2142d 1G" returned: 0 in 1.428s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a4c3e338-6978-41ce-8bdd-351b9b80954c tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.4d5abbd8-11ea-4862-9b14-759e09c2142d {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:04 devstack sudo[95448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.4d5abbd8-11ea-4862-9b14-759e09c2142d Jul 08 01:13:04 devstack sudo[95448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:05 devstack sudo[95448]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a4c3e338-6978-41ce-8bdd-351b9b80954c tempest-SnapshotsActionsTest-433556109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.4d5abbd8-11ea-4862-9b14-759e09c2142d" returned: 0 in 1.189s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:05 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-a4c3e338-6978-41ce-8bdd-351b9b80954c tempest-SnapshotsActionsTest-433556109 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.4d5abbd8-11ea-4862-9b14-759e09c2142d is being set with open permissions: ugo+rw Jul 08 01:13:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a4c3e338-6978-41ce-8bdd-351b9b80954c tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.4d5abbd8-11ea-4862-9b14-759e09c2142d {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:05 devstack sudo[95473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.4d5abbd8-11ea-4862-9b14-759e09c2142d Jul 08 01:13:05 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:06 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a4c3e338-6978-41ce-8bdd-351b9b80954c tempest-SnapshotsActionsTest-433556109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.4d5abbd8-11ea-4862-9b14-759e09c2142d" returned: 0 in 0.869s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a4c3e338-6978-41ce-8bdd-351b9b80954c tempest-SnapshotsActionsTest-433556109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.856s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:06 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-a4c3e338-6978-41ce-8bdd-351b9b80954c tempest-SnapshotsActionsTest-433556109 None] Create snapshot completed successfully Jul 08 01:13:07 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e3cc6746-d19a-42fb-bb40-c5a05d36d380 tempest-SnapshotsActionsTest-960723725 None] Acquiring lock "cinder-4d5abbd8-11ea-4862-9b14-759e09c2142d-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:07 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e3cc6746-d19a-42fb-bb40-c5a05d36d380 tempest-SnapshotsActionsTest-960723725 None] Lock "cinder-4d5abbd8-11ea-4862-9b14-759e09c2142d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:07 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e3cc6746-d19a-42fb-bb40-c5a05d36d380 tempest-SnapshotsActionsTest-960723725 None] Acquiring lock "cinder-quobyte-cab69977-3681-426e-b914-69acccb59304" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:07 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e3cc6746-d19a-42fb-bb40-c5a05d36d380 tempest-SnapshotsActionsTest-960723725 None] Lock "cinder-quobyte-cab69977-3681-426e-b914-69acccb59304" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:07 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e3cc6746-d19a-42fb-bb40-c5a05d36d380 tempest-SnapshotsActionsTest-960723725 None] Acquiring lock "cinder-quobyte-4d5abbd8-11ea-4862-9b14-759e09c2142d" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:07 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e3cc6746-d19a-42fb-bb40-c5a05d36d380 tempest-SnapshotsActionsTest-960723725 None] Lock "cinder-quobyte-4d5abbd8-11ea-4862-9b14-759e09c2142d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:07 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-e3cc6746-d19a-42fb-bb40-c5a05d36d380 tempest-SnapshotsActionsTest-960723725 None] Deleting offline snapshot 4d5abbd8-11ea-4862-9b14-759e09c2142d of volume cab69977-3681-426e-b914-69acccb59304 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:13:07 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-e3cc6746-d19a-42fb-bb40-c5a05d36d380 tempest-SnapshotsActionsTest-960723725 None] snapshot_file for this snap is: volume-cab69977-3681-426e-b914-69acccb59304.4d5abbd8-11ea-4862-9b14-759e09c2142d {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:13:07 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e235776-f7c2-4215-a5fa-85e0cad0fca6]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3cc6746-d19a-42fb-bb40-c5a05d36d380 tempest-SnapshotsActionsTest-960723725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.4d5abbd8-11ea-4862-9b14-759e09c2142d {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:07 devstack sudo[95481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.4d5abbd8-11ea-4862-9b14-759e09c2142d Jul 08 01:13:07 devstack sudo[95481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:08 devstack sudo[95481]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3cc6746-d19a-42fb-bb40-c5a05d36d380 tempest-SnapshotsActionsTest-960723725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.4d5abbd8-11ea-4862-9b14-759e09c2142d" returned: 0 in 1.048s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:08 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-e3cc6746-d19a-42fb-bb40-c5a05d36d380 tempest-SnapshotsActionsTest-960723725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cab69977-3681-426e-b914-69acccb59304(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:13:08 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e919bf7-87e9-44ef-99b7-2ff6119b524f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3cc6746-d19a-42fb-bb40-c5a05d36d380 tempest-SnapshotsActionsTest-960723725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:08 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a Jul 08 01:13:08 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:09 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3cc6746-d19a-42fb-bb40-c5a05d36d380 tempest-SnapshotsActionsTest-960723725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a" returned: 0 in 0.986s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-e3cc6746-d19a-42fb-bb40-c5a05d36d380 tempest-SnapshotsActionsTest-960723725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cab69977-3681-426e-b914-69acccb59304(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:13:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3cc6746-d19a-42fb-bb40-c5a05d36d380 tempest-SnapshotsActionsTest-960723725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.4d5abbd8-11ea-4862-9b14-759e09c2142d {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:09 devstack sudo[95493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.4d5abbd8-11ea-4862-9b14-759e09c2142d Jul 08 01:13:09 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:10 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3cc6746-d19a-42fb-bb40-c5a05d36d380 tempest-SnapshotsActionsTest-960723725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.4d5abbd8-11ea-4862-9b14-759e09c2142d" returned: 0 in 0.934s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3cc6746-d19a-42fb-bb40-c5a05d36d380 tempest-SnapshotsActionsTest-960723725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.4d5abbd8-11ea-4862-9b14-759e09c2142d {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:10 devstack sudo[95498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.4d5abbd8-11ea-4862-9b14-759e09c2142d Jul 08 01:13:10 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:11 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3cc6746-d19a-42fb-bb40-c5a05d36d380 tempest-SnapshotsActionsTest-960723725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.4d5abbd8-11ea-4862-9b14-759e09c2142d" returned: 0 in 0.794s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:11 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e3cc6746-d19a-42fb-bb40-c5a05d36d380 tempest-SnapshotsActionsTest-960723725 None] Lock "cinder-quobyte-4d5abbd8-11ea-4862-9b14-759e09c2142d" released by "_delete_snapshot" :: held 3.947s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:11 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e3cc6746-d19a-42fb-bb40-c5a05d36d380 tempest-SnapshotsActionsTest-960723725 None] Lock "cinder-quobyte-cab69977-3681-426e-b914-69acccb59304" released by "delete_snapshot" :: held 3.977s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:11 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-e3cc6746-d19a-42fb-bb40-c5a05d36d380 tempest-SnapshotsActionsTest-960723725 None] Created reservations ['19d3633a-bd6c-4409-beae-c8cd27d89e7c', '3551bb4d-7898-4bb8-8b7b-52f86f62061c', '5ec2334d-0743-4c1c-a47b-50be0e1713fc', '068c8e0c-aad5-4e32-b88c-4a868428dd1c'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:13:11 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-e3cc6746-d19a-42fb-bb40-c5a05d36d380 tempest-SnapshotsActionsTest-960723725 None] Delete snapshot completed successfully. Jul 08 01:13:11 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e3cc6746-d19a-42fb-bb40-c5a05d36d380 tempest-SnapshotsActionsTest-960723725 None] Lock "cinder-4d5abbd8-11ea-4862-9b14-759e09c2142d-delete_snapshot" released by "delete_snapshot" :: held 4.256s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:11 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:13:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Flow 'volume_create_manager' (c443819f-bc93-4224-8fee-851a044c3532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f300054a-87a0-4673-90a0-0a7d95045469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f300054a-87a0-4673-90a0-0a7d95045469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-98998494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb4926bd-c2c3-4c4d-8123-e9a8df9942f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f0d3bb3aa8ce4e91893823a8439541ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:12Z,use_quota=True,user_id='ac3c138cea644002a499db5bd797c902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fffa282d-7280-49d6-96c1-a420b93fec35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fffa282d-7280-49d6-96c1-a420b93fec35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7e68aca-6933-48bf-aff9-bfef7b55136d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7e68aca-6933-48bf-aff9-bfef7b55136d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb4926bd-c2c3-4c4d-8123-e9a8df9942f8', 'volume_name': 'volume-fb4926bd-c2c3-4c4d-8123-e9a8df9942f8', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca15f716-f631-42b7-b72f-97bc9d9f6d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca15f716-f631-42b7-b72f-97bc9d9f6d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4897131f-04a0-4a79-8446-4c0808632f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:11 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Volume fb4926bd-c2c3-4c4d-8123-e9a8df9942f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb4926bd-c2c3-4c4d-8123-e9a8df9942f8', 'volume_size': 1} Jul 08 01:13:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:11 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-98998494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb4926bd-c2c3-4c4d-8123-e9a8df9942f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f0d3bb3aa8ce4e91893823a8439541ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:12Z,use_quota=True,user_id='ac3c138cea644002a499db5bd797c902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:13:11 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Creating volume fb4926bd-c2c3-4c4d-8123-e9a8df9942f8 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:13:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:11 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:11 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:11 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:13:11 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:13:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb4926bd-c2c3-4c4d-8123-e9a8df9942f8 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:11 devstack sudo[95501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb4926bd-c2c3-4c4d-8123-e9a8df9942f8 1073741824 Jul 08 01:13:11 devstack sudo[95501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a097281c-f9b7-4974-91a9-77d487e4a7e2 tempest-SnapshotsActionsTest-433556109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:12 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-48f7082d-3a19-4bc4-b337-6f5f5cd11a04 tempest-AttachVolumeTestJSON-1253782169 None] Acquiring lock "cinder-9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:12 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-48f7082d-3a19-4bc4-b337-6f5f5cd11a04 tempest-AttachVolumeTestJSON-1253782169 None] Lock "cinder-9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:12 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-48f7082d-3a19-4bc4-b337-6f5f5cd11a04 tempest-AttachVolumeTestJSON-1253782169 None] Acquiring lock "cinder-quobyte-9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:12 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-48f7082d-3a19-4bc4-b337-6f5f5cd11a04 tempest-AttachVolumeTestJSON-1253782169 None] Lock "cinder-quobyte-9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0" acquired by "delete_volume" :: waited 0.024s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:12 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6254eb2-04a2-41b7-a8b7-ede2e4bb9549]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-48f7082d-3a19-4bc4-b337-6f5f5cd11a04 tempest-AttachVolumeTestJSON-1253782169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:12 devstack sudo[95503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0 Jul 08 01:13:12 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:13 devstack sudo[95501]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb4926bd-c2c3-4c4d-8123-e9a8df9942f8 1073741824" returned: 0 in 1.130s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb4926bd-c2c3-4c4d-8123-e9a8df9942f8 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:13 devstack sudo[95509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb4926bd-c2c3-4c4d-8123-e9a8df9942f8 Jul 08 01:13:13 devstack sudo[95509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:13 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-48f7082d-3a19-4bc4-b337-6f5f5cd11a04 tempest-AttachVolumeTestJSON-1253782169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0" returned: 0 in 0.894s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-48f7082d-3a19-4bc4-b337-6f5f5cd11a04 tempest-AttachVolumeTestJSON-1253782169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:13 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0 Jul 08 01:13:13 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:13 devstack sudo[95509]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb4926bd-c2c3-4c4d-8123-e9a8df9942f8" returned: 0 in 0.734s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] <== create_volume: return (1912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:13:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.916s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a097281c-f9b7-4974-91a9-77d487e4a7e2 tempest-SnapshotsActionsTest-433556109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.414s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4897131f-04a0-4a79-8446-4c0808632f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb4926bd-c2c3-4c4d-8123-e9a8df9942f8', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (481d47ba-9a70-4682-ab35-ae983ed45faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-a097281c-f9b7-4974-91a9-77d487e4a7e2 tempest-SnapshotsActionsTest-433556109 None] Creating offline snapshot 5cb30dc9-15d7-4242-a402-e55a304e73d7 of volume cab69977-3681-426e-b914-69acccb59304 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:13:13 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Volume volume-fb4926bd-c2c3-4c4d-8123-e9a8df9942f8 (fb4926bd-c2c3-4c4d-8123-e9a8df9942f8): created successfully Jul 08 01:13:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (481d47ba-9a70-4682-ab35-ae983ed45faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Flow 'volume_create_manager' (c443819f-bc93-4224-8fee-851a044c3532) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:13 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22c1f68-d283-4aa0-b8bb-376f16a8cb56]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a097281c-f9b7-4974-91a9-77d487e4a7e2 tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:13 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-6573d6a8-e06a-46da-9895-764f812c92a0 tempest-VolumesTestJSON-1331090276 None] Created volume successfully. Jul 08 01:13:14 devstack sudo[95518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a Jul 08 01:13:14 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:14 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-48f7082d-3a19-4bc4-b337-6f5f5cd11a04 tempest-AttachVolumeTestJSON-1253782169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0" returned: 0 in 0.781s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:14 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-48f7082d-3a19-4bc4-b337-6f5f5cd11a04 tempest-AttachVolumeTestJSON-1253782169 None] Lock "cinder-quobyte-9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0" released by "delete_volume" :: held 1.749s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:14 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-48f7082d-3a19-4bc4-b337-6f5f5cd11a04 tempest-AttachVolumeTestJSON-1253782169 None] Created reservations ['4f3f8cf4-a295-473b-9cac-1f5dded0cc64', 'a22d2f1c-0470-4cda-ba8a-5053371f2192', '28e9d431-2acb-462d-8902-82c44fa143e4', 'ce70d603-0754-44eb-b587-361974bd2917'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:13:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-48f7082d-3a19-4bc4-b337-6f5f5cd11a04 tempest-AttachVolumeTestJSON-1253782169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-48f7082d-3a19-4bc4-b337-6f5f5cd11a04 tempest-AttachVolumeTestJSON-1253782169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-48f7082d-3a19-4bc4-b337-6f5f5cd11a04 tempest-AttachVolumeTestJSON-1253782169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-48f7082d-3a19-4bc4-b337-6f5f5cd11a04 tempest-AttachVolumeTestJSON-1253782169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-48f7082d-3a19-4bc4-b337-6f5f5cd11a04 tempest-AttachVolumeTestJSON-1253782169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-48f7082d-3a19-4bc4-b337-6f5f5cd11a04 tempest-AttachVolumeTestJSON-1253782169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:14 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:13:14 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:14 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f970638c-c249-4958-906a-d959e5dd5487 tempest-AttachVolumeTestJSON-1253782169 None] Acquiring lock "cinder-a9f9870f-2660-4258-b63f-a7423f5ea693-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:14 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f970638c-c249-4958-906a-d959e5dd5487 tempest-AttachVolumeTestJSON-1253782169 None] Lock "cinder-a9f9870f-2660-4258-b63f-a7423f5ea693-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:14 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f970638c-c249-4958-906a-d959e5dd5487 tempest-AttachVolumeTestJSON-1253782169 None] Acquiring lock "cinder-quobyte-a9f9870f-2660-4258-b63f-a7423f5ea693" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:14 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:14 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f970638c-c249-4958-906a-d959e5dd5487 tempest-AttachVolumeTestJSON-1253782169 None] Lock "cinder-quobyte-a9f9870f-2660-4258-b63f-a7423f5ea693" acquired by "delete_volume" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a097281c-f9b7-4974-91a9-77d487e4a7e2 tempest-SnapshotsActionsTest-433556109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a" returned: 0 in 1.029s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-a097281c-f9b7-4974-91a9-77d487e4a7e2 tempest-SnapshotsActionsTest-433556109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cab69977-3681-426e-b914-69acccb59304(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:13:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a097281c-f9b7-4974-91a9-77d487e4a7e2 tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.5cb30dc9-15d7-4242-a402-e55a304e73d7 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:15 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[80905b39-23f7-4efa-8a11-ddd027ff12d8]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f970638c-c249-4958-906a-d959e5dd5487 tempest-AttachVolumeTestJSON-1253782169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a9f9870f-2660-4258-b63f-a7423f5ea693 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:15 devstack sudo[95531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.5cb30dc9-15d7-4242-a402-e55a304e73d7 1G Jul 08 01:13:15 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:15 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a9f9870f-2660-4258-b63f-a7423f5ea693 Jul 08 01:13:15 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:15 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-48f7082d-3a19-4bc4-b337-6f5f5cd11a04 tempest-AttachVolumeTestJSON-1253782169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.092s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:15 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-48f7082d-3a19-4bc4-b337-6f5f5cd11a04 tempest-AttachVolumeTestJSON-1253782169 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:13:15 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-48f7082d-3a19-4bc4-b337-6f5f5cd11a04 tempest-AttachVolumeTestJSON-1253782169 None] Deleted volume successfully. Jul 08 01:13:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-48f7082d-3a19-4bc4-b337-6f5f5cd11a04 tempest-AttachVolumeTestJSON-1253782169 None] Lock "cinder-9d5aa3bd-7a8f-449c-b6b6-3f2727aa59e0-delete_volume" released by "delete_volume" :: held 3.135s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:15 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:13:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Flow 'volume_create_manager' (af6ea4c2-e957-429a-b99b-ae30d76ef798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1cc401b-43c8-48e8-b5a3-2957fbb95664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1cc401b-43c8-48e8-b5a3-2957fbb95664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1770195011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=482c5a60-5fe7-4909-a402-42493988f3f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f0d3bb3aa8ce4e91893823a8439541ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:16Z,use_quota=True,user_id='ac3c138cea644002a499db5bd797c902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a836a38-34ec-478b-8100-607cf4ea10b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a836a38-34ec-478b-8100-607cf4ea10b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff51063-3954-41a8-9c83-955590e74cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff51063-3954-41a8-9c83-955590e74cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '482c5a60-5fe7-4909-a402-42493988f3f8', 'volume_name': 'volume-482c5a60-5fe7-4909-a402-42493988f3f8', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee80d47-e2fa-40c0-98d3-25f9e7338601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee80d47-e2fa-40c0-98d3-25f9e7338601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:16 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6874967-5945-467f-8c5e-a6f211922d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:16 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Volume 482c5a60-5fe7-4909-a402-42493988f3f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-482c5a60-5fe7-4909-a402-42493988f3f8', 'volume_size': 1} Jul 08 01:13:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f970638c-c249-4958-906a-d959e5dd5487 tempest-AttachVolumeTestJSON-1253782169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a9f9870f-2660-4258-b63f-a7423f5ea693" returned: 0 in 1.104s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f970638c-c249-4958-906a-d959e5dd5487 tempest-AttachVolumeTestJSON-1253782169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a9f9870f-2660-4258-b63f-a7423f5ea693 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:16 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a097281c-f9b7-4974-91a9-77d487e4a7e2 tempest-SnapshotsActionsTest-433556109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.5cb30dc9-15d7-4242-a402-e55a304e73d7 1G" returned: 0 in 1.141s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a097281c-f9b7-4974-91a9-77d487e4a7e2 tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.5cb30dc9-15d7-4242-a402-e55a304e73d7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:16 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a9f9870f-2660-4258-b63f-a7423f5ea693 Jul 08 01:13:16 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:16 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.5cb30dc9-15d7-4242-a402-e55a304e73d7 Jul 08 01:13:16 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:16 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f970638c-c249-4958-906a-d959e5dd5487 tempest-AttachVolumeTestJSON-1253782169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a9f9870f-2660-4258-b63f-a7423f5ea693" returned: 0 in 0.733s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f970638c-c249-4958-906a-d959e5dd5487 tempest-AttachVolumeTestJSON-1253782169 None] Lock "cinder-quobyte-a9f9870f-2660-4258-b63f-a7423f5ea693" released by "delete_volume" :: held 1.918s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:16 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a097281c-f9b7-4974-91a9-77d487e4a7e2 tempest-SnapshotsActionsTest-433556109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.5cb30dc9-15d7-4242-a402-e55a304e73d7" returned: 0 in 0.764s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:16 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-a097281c-f9b7-4974-91a9-77d487e4a7e2 tempest-SnapshotsActionsTest-433556109 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.5cb30dc9-15d7-4242-a402-e55a304e73d7 is being set with open permissions: ugo+rw Jul 08 01:13:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a097281c-f9b7-4974-91a9-77d487e4a7e2 tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.5cb30dc9-15d7-4242-a402-e55a304e73d7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:16 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.5cb30dc9-15d7-4242-a402-e55a304e73d7 Jul 08 01:13:16 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:16 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-f970638c-c249-4958-906a-d959e5dd5487 tempest-AttachVolumeTestJSON-1253782169 None] Created reservations ['4d1383f5-85c8-4487-aa2a-0219f268aa9a', 'd5a2f503-bb74-4557-9152-4dbda5e1de1c', 'df075bee-de43-48e0-b8e1-8825496be381', '1643ba49-6434-43ce-a3e8-a3e0e4c7d774'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:13:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f970638c-c249-4958-906a-d959e5dd5487 tempest-AttachVolumeTestJSON-1253782169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f970638c-c249-4958-906a-d959e5dd5487 tempest-AttachVolumeTestJSON-1253782169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f970638c-c249-4958-906a-d959e5dd5487 tempest-AttachVolumeTestJSON-1253782169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f970638c-c249-4958-906a-d959e5dd5487 tempest-AttachVolumeTestJSON-1253782169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f970638c-c249-4958-906a-d959e5dd5487 tempest-AttachVolumeTestJSON-1253782169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f970638c-c249-4958-906a-d959e5dd5487 tempest-AttachVolumeTestJSON-1253782169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:17 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:13:17 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:17 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bee1c619-60f4-4f95-b51d-168216b96f0d tempest-AttachVolumeTestJSON-1253782169 None] Acquiring lock "cinder-b5f21dd4-9a7b-46c3-92c1-67241c03b050-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:17 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bee1c619-60f4-4f95-b51d-168216b96f0d tempest-AttachVolumeTestJSON-1253782169 None] Lock "cinder-b5f21dd4-9a7b-46c3-92c1-67241c03b050-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:17 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bee1c619-60f4-4f95-b51d-168216b96f0d tempest-AttachVolumeTestJSON-1253782169 None] Acquiring lock "cinder-quobyte-b5f21dd4-9a7b-46c3-92c1-67241c03b050" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:17 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bee1c619-60f4-4f95-b51d-168216b96f0d tempest-AttachVolumeTestJSON-1253782169 None] Lock "cinder-quobyte-b5f21dd4-9a7b-46c3-92c1-67241c03b050" acquired by "delete_volume" :: waited 0.019s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:17 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9353b6-f0fd-4abd-be4f-cac0b04001f0]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bee1c619-60f4-4f95-b51d-168216b96f0d tempest-AttachVolumeTestJSON-1253782169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b5f21dd4-9a7b-46c3-92c1-67241c03b050 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:17 devstack sudo[95557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b5f21dd4-9a7b-46c3-92c1-67241c03b050 Jul 08 01:13:17 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:17 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a097281c-f9b7-4974-91a9-77d487e4a7e2 tempest-SnapshotsActionsTest-433556109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.5cb30dc9-15d7-4242-a402-e55a304e73d7" returned: 0 in 0.744s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a097281c-f9b7-4974-91a9-77d487e4a7e2 tempest-SnapshotsActionsTest-433556109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.839s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.569s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1770195011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=482c5a60-5fe7-4909-a402-42493988f3f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f0d3bb3aa8ce4e91893823a8439541ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:16Z,use_quota=True,user_id='ac3c138cea644002a499db5bd797c902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:13:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Creating volume 482c5a60-5fe7-4909-a402-42493988f3f8 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:13:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:13:17 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:13:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-482c5a60-5fe7-4909-a402-42493988f3f8 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:17 devstack sudo[95560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-482c5a60-5fe7-4909-a402-42493988f3f8 1073741824 Jul 08 01:13:17 devstack sudo[95560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:17 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-a097281c-f9b7-4974-91a9-77d487e4a7e2 tempest-SnapshotsActionsTest-433556109 None] Create snapshot completed successfully Jul 08 01:13:17 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f970638c-c249-4958-906a-d959e5dd5487 tempest-AttachVolumeTestJSON-1253782169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.851s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:17 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-f970638c-c249-4958-906a-d959e5dd5487 tempest-AttachVolumeTestJSON-1253782169 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:13:17 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-f970638c-c249-4958-906a-d959e5dd5487 tempest-AttachVolumeTestJSON-1253782169 None] Deleted volume successfully. Jul 08 01:13:17 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f970638c-c249-4958-906a-d959e5dd5487 tempest-AttachVolumeTestJSON-1253782169 None] Lock "cinder-a9f9870f-2660-4258-b63f-a7423f5ea693-delete_volume" released by "delete_volume" :: held 3.078s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:18 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bee1c619-60f4-4f95-b51d-168216b96f0d tempest-AttachVolumeTestJSON-1253782169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b5f21dd4-9a7b-46c3-92c1-67241c03b050" returned: 0 in 0.894s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bee1c619-60f4-4f95-b51d-168216b96f0d tempest-AttachVolumeTestJSON-1253782169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b5f21dd4-9a7b-46c3-92c1-67241c03b050 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:18 devstack sudo[95567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b5f21dd4-9a7b-46c3-92c1-67241c03b050 Jul 08 01:13:18 devstack sudo[95567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:18 devstack sudo[95560]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-482c5a60-5fe7-4909-a402-42493988f3f8 1073741824" returned: 0 in 1.067s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-482c5a60-5fe7-4909-a402-42493988f3f8 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6bea199d-9e4e-4db2-b6dd-0002e5ded105 tempest-SnapshotsActionsTest-960723725 None] Acquiring lock "cinder-5cb30dc9-15d7-4242-a402-e55a304e73d7-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:18 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-482c5a60-5fe7-4909-a402-42493988f3f8 Jul 08 01:13:18 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6bea199d-9e4e-4db2-b6dd-0002e5ded105 tempest-SnapshotsActionsTest-960723725 None] Lock "cinder-5cb30dc9-15d7-4242-a402-e55a304e73d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6bea199d-9e4e-4db2-b6dd-0002e5ded105 tempest-SnapshotsActionsTest-960723725 None] Acquiring lock "cinder-quobyte-cab69977-3681-426e-b914-69acccb59304" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6bea199d-9e4e-4db2-b6dd-0002e5ded105 tempest-SnapshotsActionsTest-960723725 None] Lock "cinder-quobyte-cab69977-3681-426e-b914-69acccb59304" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6bea199d-9e4e-4db2-b6dd-0002e5ded105 tempest-SnapshotsActionsTest-960723725 None] Acquiring lock "cinder-quobyte-5cb30dc9-15d7-4242-a402-e55a304e73d7" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6bea199d-9e4e-4db2-b6dd-0002e5ded105 tempest-SnapshotsActionsTest-960723725 None] Lock "cinder-quobyte-5cb30dc9-15d7-4242-a402-e55a304e73d7" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-6bea199d-9e4e-4db2-b6dd-0002e5ded105 tempest-SnapshotsActionsTest-960723725 None] Deleting offline snapshot 5cb30dc9-15d7-4242-a402-e55a304e73d7 of volume cab69977-3681-426e-b914-69acccb59304 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:13:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-6bea199d-9e4e-4db2-b6dd-0002e5ded105 tempest-SnapshotsActionsTest-960723725 None] snapshot_file for this snap is: volume-cab69977-3681-426e-b914-69acccb59304.5cb30dc9-15d7-4242-a402-e55a304e73d7 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:13:18 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb8c820-e55e-413e-80b5-c0c5fc317327]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6bea199d-9e4e-4db2-b6dd-0002e5ded105 tempest-SnapshotsActionsTest-960723725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.5cb30dc9-15d7-4242-a402-e55a304e73d7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:19 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.5cb30dc9-15d7-4242-a402-e55a304e73d7 Jul 08 01:13:19 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:19 devstack sudo[95567]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bee1c619-60f4-4f95-b51d-168216b96f0d tempest-AttachVolumeTestJSON-1253782169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b5f21dd4-9a7b-46c3-92c1-67241c03b050" returned: 0 in 0.883s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bee1c619-60f4-4f95-b51d-168216b96f0d tempest-AttachVolumeTestJSON-1253782169 None] Lock "cinder-quobyte-b5f21dd4-9a7b-46c3-92c1-67241c03b050" released by "delete_volume" :: held 1.831s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:19 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-bee1c619-60f4-4f95-b51d-168216b96f0d tempest-AttachVolumeTestJSON-1253782169 None] Created reservations ['e1b12e59-3d2c-4d11-a8d4-45737b073ffb', '19ef80d2-337b-4807-82b0-97b467eaa64c', '3b1ae776-0b4d-4084-816a-dae5ff6862a0', 'f14be770-6d2c-462d-823c-6759d6d32668'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:13:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bee1c619-60f4-4f95-b51d-168216b96f0d tempest-AttachVolumeTestJSON-1253782169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bee1c619-60f4-4f95-b51d-168216b96f0d tempest-AttachVolumeTestJSON-1253782169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bee1c619-60f4-4f95-b51d-168216b96f0d tempest-AttachVolumeTestJSON-1253782169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bee1c619-60f4-4f95-b51d-168216b96f0d tempest-AttachVolumeTestJSON-1253782169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bee1c619-60f4-4f95-b51d-168216b96f0d tempest-AttachVolumeTestJSON-1253782169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bee1c619-60f4-4f95-b51d-168216b96f0d tempest-AttachVolumeTestJSON-1253782169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:19 devstack sudo[95578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:13:19 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:19 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-482c5a60-5fe7-4909-a402-42493988f3f8" returned: 0 in 1.018s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] <== create_volume: return (2136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:13:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.140s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6874967-5945-467f-8c5e-a6f211922d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-482c5a60-5fe7-4909-a402-42493988f3f8', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc5ffb3-098c-410e-99ab-76f85205eb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:19 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Volume volume-482c5a60-5fe7-4909-a402-42493988f3f8 (482c5a60-5fe7-4909-a402-42493988f3f8): created successfully Jul 08 01:13:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc5ffb3-098c-410e-99ab-76f85205eb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Flow 'volume_create_manager' (af6ea4c2-e957-429a-b99b-ae30d76ef798) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:19 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-482f2738-a22c-4cbd-97b4-e3ba5fdf981e tempest-VolumesTestJSON-1331090276 None] Created volume successfully. Jul 08 01:13:20 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6bea199d-9e4e-4db2-b6dd-0002e5ded105 tempest-SnapshotsActionsTest-960723725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.5cb30dc9-15d7-4242-a402-e55a304e73d7" returned: 0 in 1.200s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:20 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-6bea199d-9e4e-4db2-b6dd-0002e5ded105 tempest-SnapshotsActionsTest-960723725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cab69977-3681-426e-b914-69acccb59304(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:13:20 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[90928ff5-dc29-4ba5-ac89-804b946881bf]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6bea199d-9e4e-4db2-b6dd-0002e5ded105 tempest-SnapshotsActionsTest-960723725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:20 devstack sudo[95585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a Jul 08 01:13:20 devstack sudo[95585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:20 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bee1c619-60f4-4f95-b51d-168216b96f0d tempest-AttachVolumeTestJSON-1253782169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.003s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:20 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-bee1c619-60f4-4f95-b51d-168216b96f0d tempest-AttachVolumeTestJSON-1253782169 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:13:20 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-bee1c619-60f4-4f95-b51d-168216b96f0d tempest-AttachVolumeTestJSON-1253782169 None] Deleted volume successfully. Jul 08 01:13:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bee1c619-60f4-4f95-b51d-168216b96f0d tempest-AttachVolumeTestJSON-1253782169 None] Lock "cinder-b5f21dd4-9a7b-46c3-92c1-67241c03b050-delete_volume" released by "delete_volume" :: held 3.151s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:21 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:13:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Flow 'volume_create_manager' (08e11190-dbee-4e20-ab65-152e261a8e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ff9a56-2f33-4069-944c-cdedf18e77ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ff9a56-2f33-4069-944c-cdedf18e77ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-864320013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aad3bf4-d038-488e-bcce-1f067de14d40,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f0d3bb3aa8ce4e91893823a8439541ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:21Z,use_quota=True,user_id='ac3c138cea644002a499db5bd797c902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c64d08c-74d0-4551-b745-02dca1762d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c64d08c-74d0-4551-b745-02dca1762d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0376d626-912b-42b6-9c89-12ba584b913e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0376d626-912b-42b6-9c89-12ba584b913e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aad3bf4-d038-488e-bcce-1f067de14d40', 'volume_name': 'volume-1aad3bf4-d038-488e-bcce-1f067de14d40', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e9a848-5403-404c-aa11-4575f570d213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e9a848-5403-404c-aa11-4575f570d213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04145cfb-48c8-4535-aa87-492b73c7eaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:21 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Volume 1aad3bf4-d038-488e-bcce-1f067de14d40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aad3bf4-d038-488e-bcce-1f067de14d40', 'volume_size': 1} Jul 08 01:13:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-864320013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aad3bf4-d038-488e-bcce-1f067de14d40,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f0d3bb3aa8ce4e91893823a8439541ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:21Z,use_quota=True,user_id='ac3c138cea644002a499db5bd797c902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:13:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Creating volume 1aad3bf4-d038-488e-bcce-1f067de14d40 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:13:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:13:21 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:13:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1aad3bf4-d038-488e-bcce-1f067de14d40 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:21 devstack sudo[95593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1aad3bf4-d038-488e-bcce-1f067de14d40 1073741824 Jul 08 01:13:21 devstack sudo[95593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:21 devstack sudo[95585]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6bea199d-9e4e-4db2-b6dd-0002e5ded105 tempest-SnapshotsActionsTest-960723725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a" returned: 0 in 1.063s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-6bea199d-9e4e-4db2-b6dd-0002e5ded105 tempest-SnapshotsActionsTest-960723725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cab69977-3681-426e-b914-69acccb59304(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:13:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6bea199d-9e4e-4db2-b6dd-0002e5ded105 tempest-SnapshotsActionsTest-960723725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.5cb30dc9-15d7-4242-a402-e55a304e73d7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:21 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.5cb30dc9-15d7-4242-a402-e55a304e73d7 Jul 08 01:13:21 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:22 devstack sudo[95593]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1aad3bf4-d038-488e-bcce-1f067de14d40 1073741824" returned: 0 in 1.136s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1aad3bf4-d038-488e-bcce-1f067de14d40 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:22 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1aad3bf4-d038-488e-bcce-1f067de14d40 Jul 08 01:13:22 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:22 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6bea199d-9e4e-4db2-b6dd-0002e5ded105 tempest-SnapshotsActionsTest-960723725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.5cb30dc9-15d7-4242-a402-e55a304e73d7" returned: 0 in 1.285s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6bea199d-9e4e-4db2-b6dd-0002e5ded105 tempest-SnapshotsActionsTest-960723725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.5cb30dc9-15d7-4242-a402-e55a304e73d7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:22 devstack sudo[95608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.5cb30dc9-15d7-4242-a402-e55a304e73d7 Jul 08 01:13:22 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:23 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1aad3bf4-d038-488e-bcce-1f067de14d40" returned: 0 in 0.845s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] <== create_volume: return (2048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:13:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.051s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04145cfb-48c8-4535-aa87-492b73c7eaa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aad3bf4-d038-488e-bcce-1f067de14d40', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b84afdf-44ed-4e9b-bda2-20936818e417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:23 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Volume volume-1aad3bf4-d038-488e-bcce-1f067de14d40 (1aad3bf4-d038-488e-bcce-1f067de14d40): created successfully Jul 08 01:13:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b84afdf-44ed-4e9b-bda2-20936818e417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Flow 'volume_create_manager' (08e11190-dbee-4e20-ab65-152e261a8e84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:23 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6bea199d-9e4e-4db2-b6dd-0002e5ded105 tempest-SnapshotsActionsTest-960723725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.5cb30dc9-15d7-4242-a402-e55a304e73d7" returned: 0 in 0.725s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:23 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-5bd1b41e-3e4e-4741-96ee-5c104b04a145 tempest-VolumesTestJSON-1331090276 None] Created volume successfully. Jul 08 01:13:23 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6bea199d-9e4e-4db2-b6dd-0002e5ded105 tempest-SnapshotsActionsTest-960723725 None] Lock "cinder-quobyte-5cb30dc9-15d7-4242-a402-e55a304e73d7" released by "_delete_snapshot" :: held 4.431s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:23 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6bea199d-9e4e-4db2-b6dd-0002e5ded105 tempest-SnapshotsActionsTest-960723725 None] Lock "cinder-quobyte-cab69977-3681-426e-b914-69acccb59304" released by "delete_snapshot" :: held 4.466s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:23 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-6bea199d-9e4e-4db2-b6dd-0002e5ded105 tempest-SnapshotsActionsTest-960723725 None] Created reservations ['f3ddbc21-acc5-489c-9171-0fc446aa8e71', 'e5c3404d-86d6-4a0f-bb1d-9cbd91e866bf', 'fe85a98f-6dbe-40f6-80ac-e4929998b399', '6dbedad7-fb63-4b46-ad40-0aadd7b6f9f4'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:13:23 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-6bea199d-9e4e-4db2-b6dd-0002e5ded105 tempest-SnapshotsActionsTest-960723725 None] Delete snapshot completed successfully. Jul 08 01:13:23 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6bea199d-9e4e-4db2-b6dd-0002e5ded105 tempest-SnapshotsActionsTest-960723725 None] Lock "cinder-5cb30dc9-15d7-4242-a402-e55a304e73d7-delete_snapshot" released by "delete_snapshot" :: held 4.627s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d3ef5396-77e7-40c0-b96e-683a6e3874fe tempest-SnapshotsActionsTest-433556109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d3ef5396-77e7-40c0-b96e-683a6e3874fe tempest-SnapshotsActionsTest-433556109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-d3ef5396-77e7-40c0-b96e-683a6e3874fe tempest-SnapshotsActionsTest-433556109 None] Creating offline snapshot 662cbd8f-7672-49ec-abb6-2ca7e199d1b5 of volume cab69977-3681-426e-b914-69acccb59304 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:13:24 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b415d9-43bb-45a0-90d9-774ab860d8f7]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d3ef5396-77e7-40c0-b96e-683a6e3874fe tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:24 devstack sudo[95612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a Jul 08 01:13:24 devstack sudo[95612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a3fb2f4c-b0fa-4293-b179-2c62eae128aa tempest-VolumesTestJSON-1331090276 None] Acquiring lock "cinder-1aad3bf4-d038-488e-bcce-1f067de14d40-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a3fb2f4c-b0fa-4293-b179-2c62eae128aa tempest-VolumesTestJSON-1331090276 None] Lock "cinder-1aad3bf4-d038-488e-bcce-1f067de14d40-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a3fb2f4c-b0fa-4293-b179-2c62eae128aa tempest-VolumesTestJSON-1331090276 None] Acquiring lock "cinder-quobyte-1aad3bf4-d038-488e-bcce-1f067de14d40" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a3fb2f4c-b0fa-4293-b179-2c62eae128aa tempest-VolumesTestJSON-1331090276 None] Lock "cinder-quobyte-1aad3bf4-d038-488e-bcce-1f067de14d40" acquired by "delete_volume" :: waited 0.024s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:25 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c487d22-f910-4d1a-af8a-d86348556658]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a3fb2f4c-b0fa-4293-b179-2c62eae128aa tempest-VolumesTestJSON-1331090276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1aad3bf4-d038-488e-bcce-1f067de14d40 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:25 devstack sudo[95612]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d3ef5396-77e7-40c0-b96e-683a6e3874fe tempest-SnapshotsActionsTest-433556109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a" returned: 0 in 1.113s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-d3ef5396-77e7-40c0-b96e-683a6e3874fe tempest-SnapshotsActionsTest-433556109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cab69977-3681-426e-b914-69acccb59304(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:13:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d3ef5396-77e7-40c0-b96e-683a6e3874fe tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.662cbd8f-7672-49ec-abb6-2ca7e199d1b5 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:25 devstack sudo[95620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.662cbd8f-7672-49ec-abb6-2ca7e199d1b5 1G Jul 08 01:13:25 devstack sudo[95620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:25 devstack sudo[95619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1aad3bf4-d038-488e-bcce-1f067de14d40 Jul 08 01:13:26 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:26 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a3fb2f4c-b0fa-4293-b179-2c62eae128aa tempest-VolumesTestJSON-1331090276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1aad3bf4-d038-488e-bcce-1f067de14d40" returned: 0 in 1.161s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a3fb2f4c-b0fa-4293-b179-2c62eae128aa tempest-VolumesTestJSON-1331090276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1aad3bf4-d038-488e-bcce-1f067de14d40 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:26 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1aad3bf4-d038-488e-bcce-1f067de14d40 Jul 08 01:13:26 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:27 devstack sudo[95620]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d3ef5396-77e7-40c0-b96e-683a6e3874fe tempest-SnapshotsActionsTest-433556109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.662cbd8f-7672-49ec-abb6-2ca7e199d1b5 1G" returned: 0 in 1.244s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d3ef5396-77e7-40c0-b96e-683a6e3874fe tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.662cbd8f-7672-49ec-abb6-2ca7e199d1b5 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:27 devstack sudo[95632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.662cbd8f-7672-49ec-abb6-2ca7e199d1b5 Jul 08 01:13:27 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:27 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a3fb2f4c-b0fa-4293-b179-2c62eae128aa tempest-VolumesTestJSON-1331090276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1aad3bf4-d038-488e-bcce-1f067de14d40" returned: 0 in 0.752s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a3fb2f4c-b0fa-4293-b179-2c62eae128aa tempest-VolumesTestJSON-1331090276 None] Lock "cinder-quobyte-1aad3bf4-d038-488e-bcce-1f067de14d40" released by "delete_volume" :: held 1.977s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:27 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-a3fb2f4c-b0fa-4293-b179-2c62eae128aa tempest-VolumesTestJSON-1331090276 None] Created reservations ['fa64dafa-5f2c-497f-824c-0696e6ce1fb5', '15afbd18-ba3a-42d9-889f-d497b4d8b7b6', 'fb89bc9f-4f80-406c-ad6d-8b6c8405a1b1', '4339881d-fd04-430f-954f-9eba74815af9'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:13:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a3fb2f4c-b0fa-4293-b179-2c62eae128aa tempest-VolumesTestJSON-1331090276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a3fb2f4c-b0fa-4293-b179-2c62eae128aa tempest-VolumesTestJSON-1331090276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a3fb2f4c-b0fa-4293-b179-2c62eae128aa tempest-VolumesTestJSON-1331090276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:27 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a3fb2f4c-b0fa-4293-b179-2c62eae128aa tempest-VolumesTestJSON-1331090276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a3fb2f4c-b0fa-4293-b179-2c62eae128aa tempest-VolumesTestJSON-1331090276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a3fb2f4c-b0fa-4293-b179-2c62eae128aa tempest-VolumesTestJSON-1331090276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d3ef5396-77e7-40c0-b96e-683a6e3874fe tempest-SnapshotsActionsTest-433556109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.662cbd8f-7672-49ec-abb6-2ca7e199d1b5" returned: 0 in 0.913s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:27 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-d3ef5396-77e7-40c0-b96e-683a6e3874fe tempest-SnapshotsActionsTest-433556109 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.662cbd8f-7672-49ec-abb6-2ca7e199d1b5 is being set with open permissions: ugo+rw Jul 08 01:13:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d3ef5396-77e7-40c0-b96e-683a6e3874fe tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.662cbd8f-7672-49ec-abb6-2ca7e199d1b5 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:28 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.662cbd8f-7672-49ec-abb6-2ca7e199d1b5 Jul 08 01:13:28 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:28 devstack sudo[95640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:13:28 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3e7732c3-3733-4ff1-9d3e-957e294b747c tempest-VolumesTestJSON-1331090276 None] Acquiring lock "cinder-482c5a60-5fe7-4909-a402-42493988f3f8-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3e7732c3-3733-4ff1-9d3e-957e294b747c tempest-VolumesTestJSON-1331090276 None] Lock "cinder-482c5a60-5fe7-4909-a402-42493988f3f8-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:28 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=97,cinder:UPDATE=104,cinder:DELETE=11,cinder:INSERT=22 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:13:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3e7732c3-3733-4ff1-9d3e-957e294b747c tempest-VolumesTestJSON-1331090276 None] Acquiring lock "cinder-quobyte-482c5a60-5fe7-4909-a402-42493988f3f8" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3e7732c3-3733-4ff1-9d3e-957e294b747c tempest-VolumesTestJSON-1331090276 None] Lock "cinder-quobyte-482c5a60-5fe7-4909-a402-42493988f3f8" acquired by "delete_volume" :: waited 0.026s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:28 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[29100b00-ef42-4954-a5ff-8a6d3e9e5fe6]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3e7732c3-3733-4ff1-9d3e-957e294b747c tempest-VolumesTestJSON-1331090276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-482c5a60-5fe7-4909-a402-42493988f3f8 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:28 devstack sudo[95644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-482c5a60-5fe7-4909-a402-42493988f3f8 Jul 08 01:13:28 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:28 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a3fb2f4c-b0fa-4293-b179-2c62eae128aa tempest-VolumesTestJSON-1331090276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.016s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:28 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-a3fb2f4c-b0fa-4293-b179-2c62eae128aa tempest-VolumesTestJSON-1331090276 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:13:28 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-a3fb2f4c-b0fa-4293-b179-2c62eae128aa tempest-VolumesTestJSON-1331090276 None] Deleted volume successfully. Jul 08 01:13:28 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d3ef5396-77e7-40c0-b96e-683a6e3874fe tempest-SnapshotsActionsTest-433556109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.662cbd8f-7672-49ec-abb6-2ca7e199d1b5" returned: 0 in 1.027s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:29 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a3fb2f4c-b0fa-4293-b179-2c62eae128aa tempest-VolumesTestJSON-1331090276 None] Lock "cinder-1aad3bf4-d038-488e-bcce-1f067de14d40-delete_volume" released by "delete_volume" :: held 3.360s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d3ef5396-77e7-40c0-b96e-683a6e3874fe tempest-SnapshotsActionsTest-433556109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.491s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:29 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-d3ef5396-77e7-40c0-b96e-683a6e3874fe tempest-SnapshotsActionsTest-433556109 None] Create snapshot completed successfully Jul 08 01:13:29 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3e7732c3-3733-4ff1-9d3e-957e294b747c tempest-VolumesTestJSON-1331090276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-482c5a60-5fe7-4909-a402-42493988f3f8" returned: 0 in 1.149s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3e7732c3-3733-4ff1-9d3e-957e294b747c tempest-VolumesTestJSON-1331090276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-482c5a60-5fe7-4909-a402-42493988f3f8 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:29 devstack sudo[95652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-482c5a60-5fe7-4909-a402-42493988f3f8 Jul 08 01:13:29 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:30 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-907be67a-1c22-4e47-83b1-178d39709e3f tempest-SnapshotsActionsTest-960723725 None] Acquiring lock "cinder-662cbd8f-7672-49ec-abb6-2ca7e199d1b5-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:30 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-907be67a-1c22-4e47-83b1-178d39709e3f tempest-SnapshotsActionsTest-960723725 None] Lock "cinder-662cbd8f-7672-49ec-abb6-2ca7e199d1b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:30 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-907be67a-1c22-4e47-83b1-178d39709e3f tempest-SnapshotsActionsTest-960723725 None] Acquiring lock "cinder-quobyte-cab69977-3681-426e-b914-69acccb59304" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:30 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-907be67a-1c22-4e47-83b1-178d39709e3f tempest-SnapshotsActionsTest-960723725 None] Lock "cinder-quobyte-cab69977-3681-426e-b914-69acccb59304" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:30 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-907be67a-1c22-4e47-83b1-178d39709e3f tempest-SnapshotsActionsTest-960723725 None] Acquiring lock "cinder-quobyte-662cbd8f-7672-49ec-abb6-2ca7e199d1b5" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:30 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-907be67a-1c22-4e47-83b1-178d39709e3f tempest-SnapshotsActionsTest-960723725 None] Lock "cinder-quobyte-662cbd8f-7672-49ec-abb6-2ca7e199d1b5" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:30 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-907be67a-1c22-4e47-83b1-178d39709e3f tempest-SnapshotsActionsTest-960723725 None] Deleting offline snapshot 662cbd8f-7672-49ec-abb6-2ca7e199d1b5 of volume cab69977-3681-426e-b914-69acccb59304 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:13:30 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-907be67a-1c22-4e47-83b1-178d39709e3f tempest-SnapshotsActionsTest-960723725 None] snapshot_file for this snap is: volume-cab69977-3681-426e-b914-69acccb59304.662cbd8f-7672-49ec-abb6-2ca7e199d1b5 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:13:30 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d02b37b-6999-480a-ba7d-86369ffeef68]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-907be67a-1c22-4e47-83b1-178d39709e3f tempest-SnapshotsActionsTest-960723725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.662cbd8f-7672-49ec-abb6-2ca7e199d1b5 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:30 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3e7732c3-3733-4ff1-9d3e-957e294b747c tempest-VolumesTestJSON-1331090276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-482c5a60-5fe7-4909-a402-42493988f3f8" returned: 0 in 0.833s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:30 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3e7732c3-3733-4ff1-9d3e-957e294b747c tempest-VolumesTestJSON-1331090276 None] Lock "cinder-quobyte-482c5a60-5fe7-4909-a402-42493988f3f8" released by "delete_volume" :: held 2.066s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:30 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-3e7732c3-3733-4ff1-9d3e-957e294b747c tempest-VolumesTestJSON-1331090276 None] Created reservations ['fc001767-69ca-4d47-b733-d9327563b078', 'a0ba49ee-8c66-4487-b174-cf4302b2f26b', '304caffe-8ddd-48dc-ac90-c279b9bcf4d5', 'efda71e9-76c2-4d8d-80ac-d289cd79d5ea'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:13:30 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.662cbd8f-7672-49ec-abb6-2ca7e199d1b5 Jul 08 01:13:30 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3e7732c3-3733-4ff1-9d3e-957e294b747c tempest-VolumesTestJSON-1331090276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3e7732c3-3733-4ff1-9d3e-957e294b747c tempest-VolumesTestJSON-1331090276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:30 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3e7732c3-3733-4ff1-9d3e-957e294b747c tempest-VolumesTestJSON-1331090276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:30 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3e7732c3-3733-4ff1-9d3e-957e294b747c tempest-VolumesTestJSON-1331090276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3e7732c3-3733-4ff1-9d3e-957e294b747c tempest-VolumesTestJSON-1331090276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3e7732c3-3733-4ff1-9d3e-957e294b747c tempest-VolumesTestJSON-1331090276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:30 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:13:30 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:31 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-907be67a-1c22-4e47-83b1-178d39709e3f tempest-SnapshotsActionsTest-960723725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.662cbd8f-7672-49ec-abb6-2ca7e199d1b5" returned: 0 in 0.921s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-907be67a-1c22-4e47-83b1-178d39709e3f tempest-SnapshotsActionsTest-960723725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cab69977-3681-426e-b914-69acccb59304(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:13:31 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a15543f-5672-4752-944f-a11188c42107]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-907be67a-1c22-4e47-83b1-178d39709e3f tempest-SnapshotsActionsTest-960723725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:31 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a Jul 08 01:13:31 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:31 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3e7732c3-3733-4ff1-9d3e-957e294b747c tempest-VolumesTestJSON-1331090276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.033s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:31 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-3e7732c3-3733-4ff1-9d3e-957e294b747c tempest-VolumesTestJSON-1331090276 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:13:31 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-3e7732c3-3733-4ff1-9d3e-957e294b747c tempest-VolumesTestJSON-1331090276 None] Deleted volume successfully. Jul 08 01:13:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3e7732c3-3733-4ff1-9d3e-957e294b747c tempest-VolumesTestJSON-1331090276 None] Lock "cinder-482c5a60-5fe7-4909-a402-42493988f3f8-delete_volume" released by "delete_volume" :: held 3.455s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6be151a0-7fdd-45ee-9153-9436c6d7e7b4 tempest-VolumesTestJSON-1331090276 None] Acquiring lock "cinder-fb4926bd-c2c3-4c4d-8123-e9a8df9942f8-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6be151a0-7fdd-45ee-9153-9436c6d7e7b4 tempest-VolumesTestJSON-1331090276 None] Lock "cinder-fb4926bd-c2c3-4c4d-8123-e9a8df9942f8-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6be151a0-7fdd-45ee-9153-9436c6d7e7b4 tempest-VolumesTestJSON-1331090276 None] Acquiring lock "cinder-quobyte-fb4926bd-c2c3-4c4d-8123-e9a8df9942f8" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6be151a0-7fdd-45ee-9153-9436c6d7e7b4 tempest-VolumesTestJSON-1331090276 None] Lock "cinder-quobyte-fb4926bd-c2c3-4c4d-8123-e9a8df9942f8" acquired by "delete_volume" :: waited 0.035s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:31 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[272c304d-ebe1-42c5-905c-bb8c9fb2a923]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6be151a0-7fdd-45ee-9153-9436c6d7e7b4 tempest-VolumesTestJSON-1331090276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb4926bd-c2c3-4c4d-8123-e9a8df9942f8 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:32 devstack sudo[95666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb4926bd-c2c3-4c4d-8123-e9a8df9942f8 Jul 08 01:13:32 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:32 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-907be67a-1c22-4e47-83b1-178d39709e3f tempest-SnapshotsActionsTest-960723725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a" returned: 0 in 1.304s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:32 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-907be67a-1c22-4e47-83b1-178d39709e3f tempest-SnapshotsActionsTest-960723725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cab69977-3681-426e-b914-69acccb59304(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:13:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-907be67a-1c22-4e47-83b1-178d39709e3f tempest-SnapshotsActionsTest-960723725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.662cbd8f-7672-49ec-abb6-2ca7e199d1b5 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:32 devstack sudo[95672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.662cbd8f-7672-49ec-abb6-2ca7e199d1b5 Jul 08 01:13:32 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:32 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6be151a0-7fdd-45ee-9153-9436c6d7e7b4 tempest-VolumesTestJSON-1331090276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb4926bd-c2c3-4c4d-8123-e9a8df9942f8" returned: 0 in 1.008s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6be151a0-7fdd-45ee-9153-9436c6d7e7b4 tempest-VolumesTestJSON-1331090276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb4926bd-c2c3-4c4d-8123-e9a8df9942f8 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:32 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb4926bd-c2c3-4c4d-8123-e9a8df9942f8 Jul 08 01:13:32 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:33 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-907be67a-1c22-4e47-83b1-178d39709e3f tempest-SnapshotsActionsTest-960723725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.662cbd8f-7672-49ec-abb6-2ca7e199d1b5" returned: 0 in 1.066s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-907be67a-1c22-4e47-83b1-178d39709e3f tempest-SnapshotsActionsTest-960723725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.662cbd8f-7672-49ec-abb6-2ca7e199d1b5 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:33 devstack sudo[95682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.662cbd8f-7672-49ec-abb6-2ca7e199d1b5 Jul 08 01:13:33 devstack sudo[95682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:33 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6be151a0-7fdd-45ee-9153-9436c6d7e7b4 tempest-VolumesTestJSON-1331090276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb4926bd-c2c3-4c4d-8123-e9a8df9942f8" returned: 0 in 0.923s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6be151a0-7fdd-45ee-9153-9436c6d7e7b4 tempest-VolumesTestJSON-1331090276 None] Lock "cinder-quobyte-fb4926bd-c2c3-4c4d-8123-e9a8df9942f8" released by "delete_volume" :: held 2.015s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:33 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-6be151a0-7fdd-45ee-9153-9436c6d7e7b4 tempest-VolumesTestJSON-1331090276 None] Created reservations ['2b80f621-6115-4b99-9e9a-d9444836c895', 'd4ce832e-834c-4e20-a7d9-639a9afb086b', '0c0c98ae-50a4-4dad-942e-7dbeecdd6523', '36b9a7ad-4172-4c66-b6a1-a299a10bcb77'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:13:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6be151a0-7fdd-45ee-9153-9436c6d7e7b4 tempest-VolumesTestJSON-1331090276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6be151a0-7fdd-45ee-9153-9436c6d7e7b4 tempest-VolumesTestJSON-1331090276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:34 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-6be151a0-7fdd-45ee-9153-9436c6d7e7b4 tempest-VolumesTestJSON-1331090276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:34 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-6be151a0-7fdd-45ee-9153-9436c6d7e7b4 tempest-VolumesTestJSON-1331090276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6be151a0-7fdd-45ee-9153-9436c6d7e7b4 tempest-VolumesTestJSON-1331090276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6be151a0-7fdd-45ee-9153-9436c6d7e7b4 tempest-VolumesTestJSON-1331090276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:34 devstack sudo[95685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:13:34 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:34 devstack sudo[95682]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-907be67a-1c22-4e47-83b1-178d39709e3f tempest-SnapshotsActionsTest-960723725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.662cbd8f-7672-49ec-abb6-2ca7e199d1b5" returned: 0 in 1.159s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:34 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-907be67a-1c22-4e47-83b1-178d39709e3f tempest-SnapshotsActionsTest-960723725 None] Lock "cinder-quobyte-662cbd8f-7672-49ec-abb6-2ca7e199d1b5" released by "_delete_snapshot" :: held 4.614s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:34 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-907be67a-1c22-4e47-83b1-178d39709e3f tempest-SnapshotsActionsTest-960723725 None] Lock "cinder-quobyte-cab69977-3681-426e-b914-69acccb59304" released by "delete_snapshot" :: held 4.674s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:34 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-907be67a-1c22-4e47-83b1-178d39709e3f tempest-SnapshotsActionsTest-960723725 None] Created reservations ['015802ad-af0a-4c9e-b624-dec22497b5c3', '8657365d-2660-4d2c-a704-93023d393ca7', '76cd3166-916b-4198-9000-598fad55e9fb', '9cd444b4-8352-4e06-9f34-fc3b872b695f'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:13:35 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-907be67a-1c22-4e47-83b1-178d39709e3f tempest-SnapshotsActionsTest-960723725 None] Delete snapshot completed successfully. Jul 08 01:13:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-907be67a-1c22-4e47-83b1-178d39709e3f tempest-SnapshotsActionsTest-960723725 None] Lock "cinder-662cbd8f-7672-49ec-abb6-2ca7e199d1b5-delete_snapshot" released by "delete_snapshot" :: held 4.973s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:35 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6be151a0-7fdd-45ee-9153-9436c6d7e7b4 tempest-VolumesTestJSON-1331090276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.139s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:35 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-6be151a0-7fdd-45ee-9153-9436c6d7e7b4 tempest-VolumesTestJSON-1331090276 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:13:35 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-6be151a0-7fdd-45ee-9153-9436c6d7e7b4 tempest-VolumesTestJSON-1331090276 None] Deleted volume successfully. Jul 08 01:13:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6be151a0-7fdd-45ee-9153-9436c6d7e7b4 tempest-VolumesTestJSON-1331090276 None] Lock "cinder-fb4926bd-c2c3-4c4d-8123-e9a8df9942f8-delete_volume" released by "delete_volume" :: held 3.557s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:36 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-1b8005d9-064d-4d66-8fa8-770beca89d8b tempest-GroupsV320Test-305183985 None] Group tempest-GroupsV320Test-Group-175510139: creating Jul 08 01:13:36 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-1b8005d9-064d-4d66-8fa8-770beca89d8b tempest-GroupsV320Test-305183985 None] Group tempest-GroupsV320Test-Group-175510139: created successfully Jul 08 01:13:36 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-1b8005d9-064d-4d66-8fa8-770beca89d8b tempest-GroupsV320Test-305183985 None] Create group completed successfully. Jul 08 01:13:36 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-31709c1b-2790-4e9d-a70a-9bd5f5a668e5 tempest-SnapshotsActionsTest-433556109 None] Acquiring lock "cinder-c7611e9a-941f-4fd0-b7de-7c8774bb081a-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:36 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-31709c1b-2790-4e9d-a70a-9bd5f5a668e5 tempest-SnapshotsActionsTest-433556109 None] Lock "cinder-c7611e9a-941f-4fd0-b7de-7c8774bb081a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:36 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-31709c1b-2790-4e9d-a70a-9bd5f5a668e5 tempest-SnapshotsActionsTest-433556109 None] Acquiring lock "cinder-quobyte-cab69977-3681-426e-b914-69acccb59304" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:36 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-31709c1b-2790-4e9d-a70a-9bd5f5a668e5 tempest-SnapshotsActionsTest-433556109 None] Lock "cinder-quobyte-cab69977-3681-426e-b914-69acccb59304" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:36 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-31709c1b-2790-4e9d-a70a-9bd5f5a668e5 tempest-SnapshotsActionsTest-433556109 None] Acquiring lock "cinder-quobyte-c7611e9a-941f-4fd0-b7de-7c8774bb081a" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:36 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-31709c1b-2790-4e9d-a70a-9bd5f5a668e5 tempest-SnapshotsActionsTest-433556109 None] Lock "cinder-quobyte-c7611e9a-941f-4fd0-b7de-7c8774bb081a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-31709c1b-2790-4e9d-a70a-9bd5f5a668e5 tempest-SnapshotsActionsTest-433556109 None] Deleting offline snapshot c7611e9a-941f-4fd0-b7de-7c8774bb081a of volume cab69977-3681-426e-b914-69acccb59304 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:13:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-31709c1b-2790-4e9d-a70a-9bd5f5a668e5 tempest-SnapshotsActionsTest-433556109 None] snapshot_file for this snap is: volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:13:36 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[21724240-d3a6-4460-b606-e8cc139f95d9]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-31709c1b-2790-4e9d-a70a-9bd5f5a668e5 tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:36 devstack sudo[95689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a Jul 08 01:13:36 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:37 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-31709c1b-2790-4e9d-a70a-9bd5f5a668e5 tempest-SnapshotsActionsTest-433556109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a" returned: 0 in 1.090s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:37 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-31709c1b-2790-4e9d-a70a-9bd5f5a668e5 tempest-SnapshotsActionsTest-433556109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cab69977-3681-426e-b914-69acccb59304(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:13:37 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab43238a-14fd-445b-b5ba-b9f8bc0f1881]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-31709c1b-2790-4e9d-a70a-9bd5f5a668e5 tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:37 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304 Jul 08 01:13:37 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:37 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-18d0029d-ba0d-476d-a93e-f2963a986cc8 tempest-GroupsV320Test-305183985 None] Created reservations ['4104e0d2-bc2e-47a5-b075-0d3862d74dfa'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:13:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-18d0029d-ba0d-476d-a93e-f2963a986cc8 tempest-GroupsV320Test-305183985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-18d0029d-ba0d-476d-a93e-f2963a986cc8 tempest-GroupsV320Test-305183985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:37 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-18d0029d-ba0d-476d-a93e-f2963a986cc8 tempest-GroupsV320Test-305183985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:37 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-18d0029d-ba0d-476d-a93e-f2963a986cc8 tempest-GroupsV320Test-305183985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-18d0029d-ba0d-476d-a93e-f2963a986cc8 tempest-GroupsV320Test-305183985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-18d0029d-ba0d-476d-a93e-f2963a986cc8 tempest-GroupsV320Test-305183985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:37 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:13:37 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:38 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-31709c1b-2790-4e9d-a70a-9bd5f5a668e5 tempest-SnapshotsActionsTest-433556109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304" returned: 0 in 1.157s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-31709c1b-2790-4e9d-a70a-9bd5f5a668e5 tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:38 devstack sudo[95706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a Jul 08 01:13:38 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:38 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-18d0029d-ba0d-476d-a93e-f2963a986cc8 tempest-GroupsV320Test-305183985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.896s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:38 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-18d0029d-ba0d-476d-a93e-f2963a986cc8 tempest-GroupsV320Test-305183985 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:13:38 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-18d0029d-ba0d-476d-a93e-f2963a986cc8 tempest-GroupsV320Test-305183985 None] Delete group completed successfully. Jul 08 01:13:39 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-31709c1b-2790-4e9d-a70a-9bd5f5a668e5 tempest-SnapshotsActionsTest-433556109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a" returned: 0 in 1.160s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-31709c1b-2790-4e9d-a70a-9bd5f5a668e5 tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:39 devstack sudo[95712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a Jul 08 01:13:39 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:40 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-31709c1b-2790-4e9d-a70a-9bd5f5a668e5 tempest-SnapshotsActionsTest-433556109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304.c7611e9a-941f-4fd0-b7de-7c8774bb081a" returned: 0 in 0.708s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-72d13af5-5733-40b2-9f06-ae98bfb71c24 tempest-BackendsCapabilitiesAdminTestsJSON-76352855 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.597396850586, 'free_capacity_gb': 1775.597396850586, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87022) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 01:13:40 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-31709c1b-2790-4e9d-a70a-9bd5f5a668e5 tempest-SnapshotsActionsTest-433556109 None] Lock "cinder-quobyte-c7611e9a-941f-4fd0-b7de-7c8774bb081a" released by "_delete_snapshot" :: held 4.310s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:40 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-31709c1b-2790-4e9d-a70a-9bd5f5a668e5 tempest-SnapshotsActionsTest-433556109 None] Lock "cinder-quobyte-cab69977-3681-426e-b914-69acccb59304" released by "delete_snapshot" :: held 4.347s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:40 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-31709c1b-2790-4e9d-a70a-9bd5f5a668e5 tempest-SnapshotsActionsTest-433556109 None] Created reservations ['b3682fc1-a91f-420f-bf40-35422f0fc167', '7aa23a20-c45e-4883-aa8d-cc085f1d79ed', '67637f23-adee-4962-a5d9-e72f9ecc6d17', '6e439b37-f67c-4d97-a3c0-f0417f22565b'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:13:40 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-31709c1b-2790-4e9d-a70a-9bd5f5a668e5 tempest-SnapshotsActionsTest-433556109 None] Delete snapshot completed successfully. Jul 08 01:13:40 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-31709c1b-2790-4e9d-a70a-9bd5f5a668e5 tempest-SnapshotsActionsTest-433556109 None] Lock "cinder-c7611e9a-941f-4fd0-b7de-7c8774bb081a-delete_snapshot" released by "delete_snapshot" :: held 4.540s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-76c65fcc-668a-4076-bc39-e8e2b93d7ac3 tempest-BackendsCapabilitiesAdminTestsJSON-76352855 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.597396850586, 'free_capacity_gb': 1775.597396850586, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87022) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 01:13:41 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d60961db-6dd3-43a5-887e-b034aa7d4c7e tempest-SnapshotsActionsTest-433556109 None] Acquiring lock "cinder-cab69977-3681-426e-b914-69acccb59304-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:41 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d60961db-6dd3-43a5-887e-b034aa7d4c7e tempest-SnapshotsActionsTest-433556109 None] Lock "cinder-cab69977-3681-426e-b914-69acccb59304-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:41 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d60961db-6dd3-43a5-887e-b034aa7d4c7e tempest-SnapshotsActionsTest-433556109 None] Acquiring lock "cinder-quobyte-cab69977-3681-426e-b914-69acccb59304" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:41 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d60961db-6dd3-43a5-887e-b034aa7d4c7e tempest-SnapshotsActionsTest-433556109 None] Lock "cinder-quobyte-cab69977-3681-426e-b914-69acccb59304" acquired by "delete_volume" :: waited 0.017s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:41 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3d28bf-d3df-4631-be05-bf1e3836d52a]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d60961db-6dd3-43a5-887e-b034aa7d4c7e tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:41 devstack sudo[95715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304 Jul 08 01:13:41 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:42 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d60961db-6dd3-43a5-887e-b034aa7d4c7e tempest-SnapshotsActionsTest-433556109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304" returned: 0 in 1.041s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d60961db-6dd3-43a5-887e-b034aa7d4c7e tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:42 devstack sudo[95720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304 Jul 08 01:13:42 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:43 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d60961db-6dd3-43a5-887e-b034aa7d4c7e tempest-SnapshotsActionsTest-433556109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cab69977-3681-426e-b914-69acccb59304" returned: 0 in 1.116s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:43 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d60961db-6dd3-43a5-887e-b034aa7d4c7e tempest-SnapshotsActionsTest-433556109 None] Lock "cinder-quobyte-cab69977-3681-426e-b914-69acccb59304" released by "delete_volume" :: held 2.265s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:44 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-d60961db-6dd3-43a5-887e-b034aa7d4c7e tempest-SnapshotsActionsTest-433556109 None] Created reservations ['ebfbec96-de4a-45e6-8370-61afb03505d7', '6cbe9839-fc2c-4522-aad3-9161729468ca', '658d6f57-d789-4206-bb23-49fc64cb6e2f', 'f0365ba7-c53f-4dcf-ac41-e5f11ffc6bf7'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:13:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d60961db-6dd3-43a5-887e-b034aa7d4c7e tempest-SnapshotsActionsTest-433556109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d60961db-6dd3-43a5-887e-b034aa7d4c7e tempest-SnapshotsActionsTest-433556109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d60961db-6dd3-43a5-887e-b034aa7d4c7e tempest-SnapshotsActionsTest-433556109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d60961db-6dd3-43a5-887e-b034aa7d4c7e tempest-SnapshotsActionsTest-433556109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d60961db-6dd3-43a5-887e-b034aa7d4c7e tempest-SnapshotsActionsTest-433556109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d60961db-6dd3-43a5-887e-b034aa7d4c7e tempest-SnapshotsActionsTest-433556109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:44 devstack sudo[95723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:13:44 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:45 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d60961db-6dd3-43a5-887e-b034aa7d4c7e tempest-SnapshotsActionsTest-433556109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.941s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:45 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-d60961db-6dd3-43a5-887e-b034aa7d4c7e tempest-SnapshotsActionsTest-433556109 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:13:45 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-d60961db-6dd3-43a5-887e-b034aa7d4c7e tempest-SnapshotsActionsTest-433556109 None] Deleted volume successfully. Jul 08 01:13:45 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d60961db-6dd3-43a5-887e-b034aa7d4c7e tempest-SnapshotsActionsTest-433556109 None] Lock "cinder-cab69977-3681-426e-b914-69acccb59304-delete_volume" released by "delete_volume" :: held 3.550s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:45 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:13:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:45 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:13:45 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:46 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.109s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:46 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:13:46 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:13:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread count: 8 {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:13:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread info: [<_MainThread(MainThread, started 134382216167552)>, , , , , , , ] {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:13:50 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-2e4b1924-2c9b-45f1-8261-26f26c6397b6 tempest-GroupSnapshotsV319Test-556920773 None] Group tempest-GroupSnapshotsV319Test-Group-1845769376: creating Jul 08 01:13:50 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-2e4b1924-2c9b-45f1-8261-26f26c6397b6 tempest-GroupSnapshotsV319Test-556920773 None] Group tempest-GroupSnapshotsV319Test-Group-1845769376: created successfully Jul 08 01:13:50 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-2e4b1924-2c9b-45f1-8261-26f26c6397b6 tempest-GroupSnapshotsV319Test-556920773 None] Create group completed successfully. Jul 08 01:13:52 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:13:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Flow 'volume_create_manager' (5a0ff705-2745-469f-9e13-f4cfa5906a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88db34cb-cf51-4760-a153-a9b7ff1dbefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88db34cb-cf51-4760-a153-a9b7ff1dbefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-379004150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e381e9e5-2c0e-4c60-b43c-de90c5bae16c,host='devstack@QuobyteHD#QuobyteHD',id=1b902347-c60b-4674-982e-26d9c6b3c61e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='630381af9d8d43bf81c69882b77fbb03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:52Z,use_quota=True,user_id='2129c646c8df457084b21d5001515935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c429ac9-6aa3-4618-af63-ea4c232cc452),volume_type_id=4c429ac9-6aa3-4618-af63-ea4c232cc452)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ffcea7f-0088-4593-a70b-fe4e9a3dfa23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ffcea7f-0088-4593-a70b-fe4e9a3dfa23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (871c935b-c97d-4db1-bd02-3d1d2baa364c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (871c935b-c97d-4db1-bd02-3d1d2baa364c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b902347-c60b-4674-982e-26d9c6b3c61e', 'volume_name': 'volume-1b902347-c60b-4674-982e-26d9c6b3c61e', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af547ad-a760-4441-bbc5-70a3376ee544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af547ad-a760-4441-bbc5-70a3376ee544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0690d7-af50-4c00-87f4-1650769f4646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:52 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Volume 1b902347-c60b-4674-982e-26d9c6b3c61e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b902347-c60b-4674-982e-26d9c6b3c61e', 'volume_size': 1} Jul 08 01:13:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e381e9e5-2c0e-4c60-b43c-de90c5bae16c,created_at=2026-07-07T23:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-379004150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e381e9e5-2c0e-4c60-b43c-de90c5bae16c,host='devstack@QuobyteHD#QuobyteHD',id=1b902347-c60b-4674-982e-26d9c6b3c61e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='630381af9d8d43bf81c69882b77fbb03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:52Z,use_quota=True,user_id='2129c646c8df457084b21d5001515935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c429ac9-6aa3-4618-af63-ea4c232cc452),volume_type_id=4c429ac9-6aa3-4618-af63-ea4c232cc452)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:13:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Creating volume 1b902347-c60b-4674-982e-26d9c6b3c61e {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:13:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:13:52 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:13:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:52 devstack sudo[95730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e 1073741824 Jul 08 01:13:52 devstack sudo[95730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:53 devstack sudo[95730]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e 1073741824" returned: 0 in 1.224s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:53 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e Jul 08 01:13:53 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:54 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e" returned: 0 in 0.930s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:54 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] <== create_volume: return (2235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:13:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.239s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:54 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0690d7-af50-4c00-87f4-1650769f4646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b902347-c60b-4674-982e-26d9c6b3c61e', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:54 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e5d4ae7-588b-465b-bf37-1d06b092ef9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:54 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Volume volume-1b902347-c60b-4674-982e-26d9c6b3c61e (1b902347-c60b-4674-982e-26d9c6b3c61e): created successfully Jul 08 01:13:54 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e5d4ae7-588b-465b-bf37-1d06b092ef9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:54 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Flow 'volume_create_manager' (5a0ff705-2745-469f-9e13-f4cfa5906a64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:54 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-11865689-d105-4de9-b9cb-a731afd1ab8e tempest-GroupSnapshotsV319Test-556920773 None] Created volume successfully. Jul 08 01:13:56 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-39a643db-956b-4da8-954f-d26377f10a27 tempest-GroupSnapshotsV319Test-556920773 None] GroupSnapshot 17990f4d-9846-4f23-8da9-bafcaf5f2cd9: creating. Jul 08 01:13:56 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-39a643db-956b-4da8-954f-d26377f10a27 tempest-GroupSnapshotsV319Test-556920773 None] Group snapshot 17990f4d-9846-4f23-8da9-bafcaf5f2cd9: creating. {{(pid=87022) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 01:13:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-39a643db-956b-4da8-954f-d26377f10a27 tempest-GroupSnapshotsV319Test-556920773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-39a643db-956b-4da8-954f-d26377f10a27 tempest-GroupSnapshotsV319Test-556920773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:56 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-39a643db-956b-4da8-954f-d26377f10a27 tempest-GroupSnapshotsV319Test-556920773 None] Creating offline snapshot e4b50256-69d8-4c13-a382-0441e28de6cd of volume 1b902347-c60b-4674-982e-26d9c6b3c61e {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:13:56 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba54231-0a64-4499-91c0-0b584392cb7c]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-39a643db-956b-4da8-954f-d26377f10a27 tempest-GroupSnapshotsV319Test-556920773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:56 devstack sudo[95739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e Jul 08 01:13:56 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:57 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-39a643db-956b-4da8-954f-d26377f10a27 tempest-GroupSnapshotsV319Test-556920773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e" returned: 0 in 1.068s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-39a643db-956b-4da8-954f-d26377f10a27 tempest-GroupSnapshotsV319Test-556920773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e.e4b50256-69d8-4c13-a382-0441e28de6cd 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:57 devstack sudo[95745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e.e4b50256-69d8-4c13-a382-0441e28de6cd 1G Jul 08 01:13:57 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:58 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-39a643db-956b-4da8-954f-d26377f10a27 tempest-GroupSnapshotsV319Test-556920773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e.e4b50256-69d8-4c13-a382-0441e28de6cd 1G" returned: 0 in 1.059s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-39a643db-956b-4da8-954f-d26377f10a27 tempest-GroupSnapshotsV319Test-556920773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b902347-c60b-4674-982e-26d9c6b3c61e -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e.e4b50256-69d8-4c13-a382-0441e28de6cd {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:58 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b902347-c60b-4674-982e-26d9c6b3c61e -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e.e4b50256-69d8-4c13-a382-0441e28de6cd Jul 08 01:13:58 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:59 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:13:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Flow 'volume_create_manager' (704b2836-dad6-467d-82a2-5c7674b46f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69eba96c-1f47-4b70-aee2-6cfcfe1e160e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69eba96c-1f47-4b70-aee2-6cfcfe1e160e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-952494155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0369c3df-11da-4aab-ac4b-52b7be5efdf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8084cb1754e4975a2aebac73f57dead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:59Z,use_quota=True,user_id='d89f7825c3d44f3fbd37e4b0709cf3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00d0754b-0321-4576-bdbe-ab8de8575710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00d0754b-0321-4576-bdbe-ab8de8575710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a365c6ce-2117-411d-b109-9d14dff948de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a365c6ce-2117-411d-b109-9d14dff948de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0369c3df-11da-4aab-ac4b-52b7be5efdf4', 'volume_name': 'volume-0369c3df-11da-4aab-ac4b-52b7be5efdf4', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc829c8-5ce8-460b-86a1-964530ed1820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc829c8-5ce8-460b-86a1-964530ed1820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc5daac6-c52b-4e87-9b71-8365cb423709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:59 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Volume 0369c3df-11da-4aab-ac4b-52b7be5efdf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0369c3df-11da-4aab-ac4b-52b7be5efdf4', 'volume_size': 1} Jul 08 01:13:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:59 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-39a643db-956b-4da8-954f-d26377f10a27 tempest-GroupSnapshotsV319Test-556920773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b902347-c60b-4674-982e-26d9c6b3c61e -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e.e4b50256-69d8-4c13-a382-0441e28de6cd" returned: 0 in 0.921s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:59 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-39a643db-956b-4da8-954f-d26377f10a27 tempest-GroupSnapshotsV319Test-556920773 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e.e4b50256-69d8-4c13-a382-0441e28de6cd is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:13:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-39a643db-956b-4da8-954f-d26377f10a27 tempest-GroupSnapshotsV319Test-556920773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e.e4b50256-69d8-4c13-a382-0441e28de6cd {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:59 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e.e4b50256-69d8-4c13-a382-0441e28de6cd Jul 08 01:13:59 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:00 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-39a643db-956b-4da8-954f-d26377f10a27 tempest-GroupSnapshotsV319Test-556920773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e.e4b50256-69d8-4c13-a382-0441e28de6cd" returned: 0 in 0.740s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-39a643db-956b-4da8-954f-d26377f10a27 tempest-GroupSnapshotsV319Test-556920773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:00 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e.info Jul 08 01:14:00 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:00 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:14:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Flow 'volume_create_manager' (06ebe654-8601-4786-a708-c0b95b3bb9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034aefd1-fb27-46f5-be7f-5106a3deda54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034aefd1-fb27-46f5-be7f-5106a3deda54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1641541860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=864840d7-f1e2-4c6e-bce1-3e0b417f87e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbb36e0b122244c99548efdadc6797de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:01Z,use_quota=True,user_id='10995bd3054a4437b7315d59e9b66f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4caf5d8a-b06d-4697-93e9-18fc5eddcc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4caf5d8a-b06d-4697-93e9-18fc5eddcc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a146d8-7710-4c90-8f6e-74b7521f10d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a146d8-7710-4c90-8f6e-74b7521f10d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '864840d7-f1e2-4c6e-bce1-3e0b417f87e9', 'volume_name': 'volume-864840d7-f1e2-4c6e-bce1-3e0b417f87e9', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a3b490a-7527-49a2-af62-6d7cfb164c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a3b490a-7527-49a2-af62-6d7cfb164c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538f693a-a17c-4ded-af6c-d752e18646d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:00 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Volume 864840d7-f1e2-4c6e-bce1-3e0b417f87e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-864840d7-f1e2-4c6e-bce1-3e0b417f87e9', 'volume_size': 1} Jul 08 01:14:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:01 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-39a643db-956b-4da8-954f-d26377f10a27 tempest-GroupSnapshotsV319Test-556920773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e.info" returned: 0 in 0.674s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:01 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-39a643db-956b-4da8-954f-d26377f10a27 tempest-GroupSnapshotsV319Test-556920773 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:14:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-39a643db-956b-4da8-954f-d26377f10a27 tempest-GroupSnapshotsV319Test-556920773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:01 devstack sudo[95764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e.info Jul 08 01:14:01 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:01 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-39a643db-956b-4da8-954f-d26377f10a27 tempest-GroupSnapshotsV319Test-556920773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e.info" returned: 0 in 0.672s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-39a643db-956b-4da8-954f-d26377f10a27 tempest-GroupSnapshotsV319Test-556920773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.234s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.337s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-952494155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0369c3df-11da-4aab-ac4b-52b7be5efdf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8084cb1754e4975a2aebac73f57dead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:59Z,use_quota=True,user_id='d89f7825c3d44f3fbd37e4b0709cf3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:14:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Creating volume 0369c3df-11da-4aab-ac4b-52b7be5efdf4 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:14:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:14:01 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:14:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0369c3df-11da-4aab-ac4b-52b7be5efdf4 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:01 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0369c3df-11da-4aab-ac4b-52b7be5efdf4 1073741824 Jul 08 01:14:01 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:01 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=85,cinder:INSERT=27,cinder:UPDATE=102,cinder:DELETE=5 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:14:01 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-39a643db-956b-4da8-954f-d26377f10a27 tempest-GroupSnapshotsV319Test-556920773 None] group_snapshot 17990f4d-9846-4f23-8da9-bafcaf5f2cd9: created successfully Jul 08 01:14:02 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0369c3df-11da-4aab-ac4b-52b7be5efdf4 1073741824" returned: 0 in 0.972s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0369c3df-11da-4aab-ac4b-52b7be5efdf4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:02 devstack sudo[95773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0369c3df-11da-4aab-ac4b-52b7be5efdf4 Jul 08 01:14:02 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:03 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-d6126ccc-b354-4f02-ab76-6d3f8275e01f tempest-GroupSnapshotsV319Test-556920773 None] group_snapshot 17990f4d-9846-4f23-8da9-bafcaf5f2cd9: deleting Jul 08 01:14:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d6126ccc-b354-4f02-ab76-6d3f8275e01f tempest-GroupSnapshotsV319Test-556920773 None] group_snapshot 17990f4d-9846-4f23-8da9-bafcaf5f2cd9: deleting {{(pid=87022) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 01:14:03 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d6126ccc-b354-4f02-ab76-6d3f8275e01f tempest-GroupSnapshotsV319Test-556920773 None] Acquiring lock "cinder-quobyte-1b902347-c60b-4674-982e-26d9c6b3c61e" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:03 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d6126ccc-b354-4f02-ab76-6d3f8275e01f tempest-GroupSnapshotsV319Test-556920773 None] Lock "cinder-quobyte-1b902347-c60b-4674-982e-26d9c6b3c61e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:03 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d6126ccc-b354-4f02-ab76-6d3f8275e01f tempest-GroupSnapshotsV319Test-556920773 None] Acquiring lock "cinder-quobyte-e4b50256-69d8-4c13-a382-0441e28de6cd" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:03 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d6126ccc-b354-4f02-ab76-6d3f8275e01f tempest-GroupSnapshotsV319Test-556920773 None] Lock "cinder-quobyte-e4b50256-69d8-4c13-a382-0441e28de6cd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:03 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-d6126ccc-b354-4f02-ab76-6d3f8275e01f tempest-GroupSnapshotsV319Test-556920773 None] Deleting offline snapshot e4b50256-69d8-4c13-a382-0441e28de6cd of volume 1b902347-c60b-4674-982e-26d9c6b3c61e {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:14:03 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:03 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-d6126ccc-b354-4f02-ab76-6d3f8275e01f tempest-GroupSnapshotsV319Test-556920773 None] snapshot_file for this snap is: volume-1b902347-c60b-4674-982e-26d9c6b3c61e.e4b50256-69d8-4c13-a382-0441e28de6cd {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:14:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0369c3df-11da-4aab-ac4b-52b7be5efdf4" returned: 0 in 0.872s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:03 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:14:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.720s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:03 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1641541860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=864840d7-f1e2-4c6e-bce1-3e0b417f87e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbb36e0b122244c99548efdadc6797de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:01Z,use_quota=True,user_id='10995bd3054a4437b7315d59e9b66f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:14:03 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Creating volume 864840d7-f1e2-4c6e-bce1-3e0b417f87e9 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:14:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:03 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:03 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:03 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:14:03 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:14:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-864840d7-f1e2-4c6e-bce1-3e0b417f87e9 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:03 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f75b47b-9d06-4c5a-81de-26e87b77ead2]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:14:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d6126ccc-b354-4f02-ab76-6d3f8275e01f tempest-GroupSnapshotsV319Test-556920773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e.e4b50256-69d8-4c13-a382-0441e28de6cd {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:03 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-864840d7-f1e2-4c6e-bce1-3e0b417f87e9 1073741824 Jul 08 01:14:03 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc5daac6-c52b-4e87-9b71-8365cb423709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0369c3df-11da-4aab-ac4b-52b7be5efdf4', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cae6d15-7568-488c-927f-9eea0c9929a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:03 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Volume volume-0369c3df-11da-4aab-ac4b-52b7be5efdf4 (0369c3df-11da-4aab-ac4b-52b7be5efdf4): created successfully Jul 08 01:14:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cae6d15-7568-488c-927f-9eea0c9929a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Flow 'volume_create_manager' (704b2836-dad6-467d-82a2-5c7674b46f21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:03 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-c2ef618c-4105-420f-accd-e32655f24a41 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Created volume successfully. Jul 08 01:14:03 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e.e4b50256-69d8-4c13-a382-0441e28de6cd Jul 08 01:14:03 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:04 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d6126ccc-b354-4f02-ab76-6d3f8275e01f tempest-GroupSnapshotsV319Test-556920773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e.e4b50256-69d8-4c13-a382-0441e28de6cd" returned: 0 in 0.959s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-d6126ccc-b354-4f02-ab76-6d3f8275e01f tempest-GroupSnapshotsV319Test-556920773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b902347-c60b-4674-982e-26d9c6b3c61e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:14:04 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89adcaa-1297-44d6-b8a6-0fcc3b191572]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:14:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d6126ccc-b354-4f02-ab76-6d3f8275e01f tempest-GroupSnapshotsV319Test-556920773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:04 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-864840d7-f1e2-4c6e-bce1-3e0b417f87e9 1073741824" returned: 0 in 1.090s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:04 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-306efc09-0938-4bf8-aeb7-06d3e7db1ec5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Acquiring lock "cinder-0369c3df-11da-4aab-ac4b-52b7be5efdf4-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-864840d7-f1e2-4c6e-bce1-3e0b417f87e9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:04 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-306efc09-0938-4bf8-aeb7-06d3e7db1ec5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Lock "cinder-0369c3df-11da-4aab-ac4b-52b7be5efdf4-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:04 devstack sudo[95789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e Jul 08 01:14:04 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:04 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-864840d7-f1e2-4c6e-bce1-3e0b417f87e9 Jul 08 01:14:04 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:04 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-306efc09-0938-4bf8-aeb7-06d3e7db1ec5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Acquiring lock "cinder-quobyte-0369c3df-11da-4aab-ac4b-52b7be5efdf4" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:05 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-306efc09-0938-4bf8-aeb7-06d3e7db1ec5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Lock "cinder-quobyte-0369c3df-11da-4aab-ac4b-52b7be5efdf4" acquired by "delete_volume" :: waited 0.034s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:05 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e19b1cf-d561-4716-8347-d86438fea7eb]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:14:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-306efc09-0938-4bf8-aeb7-06d3e7db1ec5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0369c3df-11da-4aab-ac4b-52b7be5efdf4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:05 devstack sudo[95793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0369c3df-11da-4aab-ac4b-52b7be5efdf4 Jul 08 01:14:05 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:06 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-864840d7-f1e2-4c6e-bce1-3e0b417f87e9" returned: 0 in 1.353s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:06 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] <== create_volume: return (2563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:14:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.568s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538f693a-a17c-4ded-af6c-d752e18646d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-864840d7-f1e2-4c6e-bce1-3e0b417f87e9', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f35f6387-15a7-4c5a-9ac3-508ffd460fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:06 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Volume volume-864840d7-f1e2-4c6e-bce1-3e0b417f87e9 (864840d7-f1e2-4c6e-bce1-3e0b417f87e9): created successfully Jul 08 01:14:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f35f6387-15a7-4c5a-9ac3-508ffd460fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Flow 'volume_create_manager' (06ebe654-8601-4786-a708-c0b95b3bb9c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:06 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-b82964c6-f5c2-4c0f-80bb-a57592b18d4c tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Created volume successfully. Jul 08 01:14:06 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d6126ccc-b354-4f02-ab76-6d3f8275e01f tempest-GroupSnapshotsV319Test-556920773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e" returned: 0 in 1.662s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d6126ccc-b354-4f02-ab76-6d3f8275e01f tempest-GroupSnapshotsV319Test-556920773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e.e4b50256-69d8-4c13-a382-0441e28de6cd {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:06 devstack sudo[95839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e.e4b50256-69d8-4c13-a382-0441e28de6cd Jul 08 01:14:06 devstack sudo[95839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:06 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-306efc09-0938-4bf8-aeb7-06d3e7db1ec5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0369c3df-11da-4aab-ac4b-52b7be5efdf4" returned: 0 in 1.417s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-306efc09-0938-4bf8-aeb7-06d3e7db1ec5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0369c3df-11da-4aab-ac4b-52b7be5efdf4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:06 devstack sudo[95842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0369c3df-11da-4aab-ac4b-52b7be5efdf4 Jul 08 01:14:06 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:07 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-306efc09-0938-4bf8-aeb7-06d3e7db1ec5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0369c3df-11da-4aab-ac4b-52b7be5efdf4" returned: 0 in 0.805s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:07 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-306efc09-0938-4bf8-aeb7-06d3e7db1ec5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Lock "cinder-quobyte-0369c3df-11da-4aab-ac4b-52b7be5efdf4" released by "delete_volume" :: held 2.319s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:07 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-306efc09-0938-4bf8-aeb7-06d3e7db1ec5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Created reservations ['e28277da-f1a5-4f49-bd17-cd351d099b4f', '6a6d7cfb-e1d1-456c-ad3e-42bb60fb20fa', 'e79ade34-2370-4a94-908b-d7fd8065b3c4', '4bb7c9d5-8747-4568-b26e-a39ebe526ac5'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:14:07 devstack sudo[95839]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d6126ccc-b354-4f02-ab76-6d3f8275e01f tempest-GroupSnapshotsV319Test-556920773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e.e4b50256-69d8-4c13-a382-0441e28de6cd" returned: 0 in 1.080s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d6126ccc-b354-4f02-ab76-6d3f8275e01f tempest-GroupSnapshotsV319Test-556920773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e.e4b50256-69d8-4c13-a382-0441e28de6cd {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:07 devstack sudo[95864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e.e4b50256-69d8-4c13-a382-0441e28de6cd Jul 08 01:14:07 devstack sudo[95864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-306efc09-0938-4bf8-aeb7-06d3e7db1ec5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-306efc09-0938-4bf8-aeb7-06d3e7db1ec5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:07 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-306efc09-0938-4bf8-aeb7-06d3e7db1ec5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:07 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-306efc09-0938-4bf8-aeb7-06d3e7db1ec5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-306efc09-0938-4bf8-aeb7-06d3e7db1ec5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-306efc09-0938-4bf8-aeb7-06d3e7db1ec5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:07 devstack sudo[95866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:14:07 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:08 devstack sudo[95864]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d6126ccc-b354-4f02-ab76-6d3f8275e01f tempest-GroupSnapshotsV319Test-556920773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e.e4b50256-69d8-4c13-a382-0441e28de6cd" returned: 0 in 0.885s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d6126ccc-b354-4f02-ab76-6d3f8275e01f tempest-GroupSnapshotsV319Test-556920773 None] Lock "cinder-quobyte-e4b50256-69d8-4c13-a382-0441e28de6cd" released by "_delete_snapshot" :: held 4.801s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d6126ccc-b354-4f02-ab76-6d3f8275e01f tempest-GroupSnapshotsV319Test-556920773 None] Lock "cinder-quobyte-1b902347-c60b-4674-982e-26d9c6b3c61e" released by "delete_snapshot" :: held 4.838s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:08 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-306efc09-0938-4bf8-aeb7-06d3e7db1ec5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.948s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:08 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-306efc09-0938-4bf8-aeb7-06d3e7db1ec5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:14:08 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-306efc09-0938-4bf8-aeb7-06d3e7db1ec5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Deleted volume successfully. Jul 08 01:14:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-306efc09-0938-4bf8-aeb7-06d3e7db1ec5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Lock "cinder-0369c3df-11da-4aab-ac4b-52b7be5efdf4-delete_volume" released by "delete_volume" :: held 3.660s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:08 devstack cinder-volume[87022]: WARNING cinder.quota [None req-d6126ccc-b354-4f02-ab76-6d3f8275e01f tempest-GroupSnapshotsV319Test-556920773 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-198369607 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-198369607, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:14:08 devstack cinder-volume[87022]: WARNING cinder.quota [None req-d6126ccc-b354-4f02-ab76-6d3f8275e01f tempest-GroupSnapshotsV319Test-556920773 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-198369607 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-198369607, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:14:08 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-d6126ccc-b354-4f02-ab76-6d3f8275e01f tempest-GroupSnapshotsV319Test-556920773 None] Created reservations ['95f8ece3-169f-48c9-9ef7-5224d9287efd', 'e77fa09b-2bbe-487e-9462-dcd8d9e7bf97', '36697cc3-04fd-4550-90ed-b0a22a579d76', '1f5afc10-7024-47cf-9556-609997e5ec20'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:14:08 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-d6126ccc-b354-4f02-ab76-6d3f8275e01f tempest-GroupSnapshotsV319Test-556920773 None] group_snapshot 17990f4d-9846-4f23-8da9-bafcaf5f2cd9: deleted successfully Jul 08 01:14:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ca273c1a-3377-4a8d-a22b-ca6ac0dc8b49 tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Acquiring lock "cinder-864840d7-f1e2-4c6e-bce1-3e0b417f87e9-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ca273c1a-3377-4a8d-a22b-ca6ac0dc8b49 tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Lock "cinder-864840d7-f1e2-4c6e-bce1-3e0b417f87e9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ca273c1a-3377-4a8d-a22b-ca6ac0dc8b49 tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Acquiring lock "cinder-quobyte-864840d7-f1e2-4c6e-bce1-3e0b417f87e9" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ca273c1a-3377-4a8d-a22b-ca6ac0dc8b49 tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Lock "cinder-quobyte-864840d7-f1e2-4c6e-bce1-3e0b417f87e9" acquired by "delete_volume" :: waited 0.027s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[77356b34-3d07-4c20-bd3c-9adaf7c41c44]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ca273c1a-3377-4a8d-a22b-ca6ac0dc8b49 tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-864840d7-f1e2-4c6e-bce1-3e0b417f87e9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Flow 'volume_create_manager' (6460970b-e71c-4407-9ae9-6c7bd1650bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa6817f-51f4-497e-a481-b402d4520318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:09 devstack sudo[95873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-864840d7-f1e2-4c6e-bce1-3e0b417f87e9 Jul 08 01:14:09 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa6817f-51f4-497e-a481-b402d4520318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2112558705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=979303e7-8736-4f33-9dbd-20a3f35ea53b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8084cb1754e4975a2aebac73f57dead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:09Z,use_quota=True,user_id='d89f7825c3d44f3fbd37e4b0709cf3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e7b4ed-d026-494c-b4ee-081747efd3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e7b4ed-d026-494c-b4ee-081747efd3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed9b69ed-6dc0-4dc7-b9e4-9dbb0dd13b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed9b69ed-6dc0-4dc7-b9e4-9dbb0dd13b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '979303e7-8736-4f33-9dbd-20a3f35ea53b', 'volume_name': 'volume-979303e7-8736-4f33-9dbd-20a3f35ea53b', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b406e107-941d-437a-bb26-9dec802849e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b406e107-941d-437a-bb26-9dec802849e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c826e87b-8ce8-497b-869f-c887854741f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:09 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Volume 979303e7-8736-4f33-9dbd-20a3f35ea53b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-979303e7-8736-4f33-9dbd-20a3f35ea53b', 'volume_size': 1} Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2112558705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=979303e7-8736-4f33-9dbd-20a3f35ea53b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8084cb1754e4975a2aebac73f57dead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:09Z,use_quota=True,user_id='d89f7825c3d44f3fbd37e4b0709cf3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Creating volume 979303e7-8736-4f33-9dbd-20a3f35ea53b {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:14:09 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-979303e7-8736-4f33-9dbd-20a3f35ea53b 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:09 devstack sudo[95875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-979303e7-8736-4f33-9dbd-20a3f35ea53b 1073741824 Jul 08 01:14:09 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d54ca663-a1ad-4251-9466-f7e27ea1c657 tempest-GroupSnapshotsV319Test-556920773 None] Acquiring lock "cinder-quobyte-1b902347-c60b-4674-982e-26d9c6b3c61e" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d54ca663-a1ad-4251-9466-f7e27ea1c657 tempest-GroupSnapshotsV319Test-556920773 None] Lock "cinder-quobyte-1b902347-c60b-4674-982e-26d9c6b3c61e" acquired by "delete_volume" :: waited 0.022s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62eed60-60f1-45c4-b4e5-6df401a1de62]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:14:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d54ca663-a1ad-4251-9466-f7e27ea1c657 tempest-GroupSnapshotsV319Test-556920773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:09 devstack sudo[95877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e Jul 08 01:14:09 devstack sudo[95877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:10 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ca273c1a-3377-4a8d-a22b-ca6ac0dc8b49 tempest-VolumeQuotasNegativeTestJSON-1104096219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-864840d7-f1e2-4c6e-bce1-3e0b417f87e9" returned: 0 in 0.967s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ca273c1a-3377-4a8d-a22b-ca6ac0dc8b49 tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-864840d7-f1e2-4c6e-bce1-3e0b417f87e9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:10 devstack sudo[95885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-864840d7-f1e2-4c6e-bce1-3e0b417f87e9 Jul 08 01:14:10 devstack sudo[95885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:10 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-979303e7-8736-4f33-9dbd-20a3f35ea53b 1073741824" returned: 0 in 1.093s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:10 devstack sudo[95877]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-979303e7-8736-4f33-9dbd-20a3f35ea53b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d54ca663-a1ad-4251-9466-f7e27ea1c657 tempest-GroupSnapshotsV319Test-556920773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e" returned: 0 in 0.994s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d54ca663-a1ad-4251-9466-f7e27ea1c657 tempest-GroupSnapshotsV319Test-556920773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:10 devstack sudo[95891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-979303e7-8736-4f33-9dbd-20a3f35ea53b Jul 08 01:14:10 devstack sudo[95891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:10 devstack sudo[95892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e Jul 08 01:14:10 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:10 devstack sudo[95885]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ca273c1a-3377-4a8d-a22b-ca6ac0dc8b49 tempest-VolumeQuotasNegativeTestJSON-1104096219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-864840d7-f1e2-4c6e-bce1-3e0b417f87e9" returned: 0 in 0.811s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:10 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ca273c1a-3377-4a8d-a22b-ca6ac0dc8b49 tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Lock "cinder-quobyte-864840d7-f1e2-4c6e-bce1-3e0b417f87e9" released by "delete_volume" :: held 1.837s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:10 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-ca273c1a-3377-4a8d-a22b-ca6ac0dc8b49 tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Created reservations ['30363347-998c-4524-8388-0529aeeac10c', '12687ab4-6a36-4634-8848-008db13bc2f0', 'd26ca0e4-15db-407b-91e6-49e5defabf0b', 'b60725eb-bebf-467b-9417-fa0d2ba673ed'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:14:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ca273c1a-3377-4a8d-a22b-ca6ac0dc8b49 tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ca273c1a-3377-4a8d-a22b-ca6ac0dc8b49 tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:11 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ca273c1a-3377-4a8d-a22b-ca6ac0dc8b49 tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:11 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ca273c1a-3377-4a8d-a22b-ca6ac0dc8b49 tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ca273c1a-3377-4a8d-a22b-ca6ac0dc8b49 tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ca273c1a-3377-4a8d-a22b-ca6ac0dc8b49 tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:11 devstack sudo[95897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:14:11 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:11 devstack sudo[95891]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-979303e7-8736-4f33-9dbd-20a3f35ea53b" returned: 0 in 0.686s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:11 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:14:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c826e87b-8ce8-497b-869f-c887854741f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-979303e7-8736-4f33-9dbd-20a3f35ea53b', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520f9d21-92a4-45b4-8d00-4d03e8c22751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:11 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d54ca663-a1ad-4251-9466-f7e27ea1c657 tempest-GroupSnapshotsV319Test-556920773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1b902347-c60b-4674-982e-26d9c6b3c61e" returned: 0 in 0.742s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:11 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Volume volume-979303e7-8736-4f33-9dbd-20a3f35ea53b (979303e7-8736-4f33-9dbd-20a3f35ea53b): created successfully Jul 08 01:14:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520f9d21-92a4-45b4-8d00-4d03e8c22751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Flow 'volume_create_manager' (6460970b-e71c-4407-9ae9-6c7bd1650bd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:11 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d54ca663-a1ad-4251-9466-f7e27ea1c657 tempest-GroupSnapshotsV319Test-556920773 None] Lock "cinder-quobyte-1b902347-c60b-4674-982e-26d9c6b3c61e" released by "delete_volume" :: held 1.817s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:11 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-bf7b7bf2-4f35-4a00-b99a-8bfe3afe34c5 tempest-VolumeQuotasAdminTestJSON-1047442031 None] Created volume successfully. Jul 08 01:14:11 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-d54ca663-a1ad-4251-9466-f7e27ea1c657 tempest-GroupSnapshotsV319Test-556920773 None] Created reservations ['b95828e0-e4a3-402f-b143-479c5bb27414'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:14:11 devstack cinder-volume[87022]: WARNING cinder.quota [None req-d54ca663-a1ad-4251-9466-f7e27ea1c657 tempest-GroupSnapshotsV319Test-556920773 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-198369607 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-198369607, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:14:11 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-d54ca663-a1ad-4251-9466-f7e27ea1c657 tempest-GroupSnapshotsV319Test-556920773 None] Created reservations ['98be153a-405c-4b91-b7b5-7492e83d404e', '8d0768cc-ff94-4521-a9a6-53a7af4d502c', 'b6bc4806-c480-43e7-8e25-aacc10469ca6', 'a7d5eff3-6dd9-4534-88c0-ee3dbee408f0'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:14:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d54ca663-a1ad-4251-9466-f7e27ea1c657 tempest-GroupSnapshotsV319Test-556920773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d54ca663-a1ad-4251-9466-f7e27ea1c657 tempest-GroupSnapshotsV319Test-556920773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:11 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d54ca663-a1ad-4251-9466-f7e27ea1c657 tempest-GroupSnapshotsV319Test-556920773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:11 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d54ca663-a1ad-4251-9466-f7e27ea1c657 tempest-GroupSnapshotsV319Test-556920773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d54ca663-a1ad-4251-9466-f7e27ea1c657 tempest-GroupSnapshotsV319Test-556920773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d54ca663-a1ad-4251-9466-f7e27ea1c657 tempest-GroupSnapshotsV319Test-556920773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:11 devstack sudo[95917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:14:11 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:12 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ca273c1a-3377-4a8d-a22b-ca6ac0dc8b49 tempest-VolumeQuotasNegativeTestJSON-1104096219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.268s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:12 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-ca273c1a-3377-4a8d-a22b-ca6ac0dc8b49 tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:14:12 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-ca273c1a-3377-4a8d-a22b-ca6ac0dc8b49 tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Deleted volume successfully. Jul 08 01:14:12 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ca273c1a-3377-4a8d-a22b-ca6ac0dc8b49 tempest-VolumeQuotasNegativeTestJSON-1104096219 None] Lock "cinder-864840d7-f1e2-4c6e-bce1-3e0b417f87e9-delete_volume" released by "delete_volume" :: held 3.383s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:13 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d54ca663-a1ad-4251-9466-f7e27ea1c657 tempest-GroupSnapshotsV319Test-556920773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.339s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:13 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-d54ca663-a1ad-4251-9466-f7e27ea1c657 tempest-GroupSnapshotsV319Test-556920773 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:14:13 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-d54ca663-a1ad-4251-9466-f7e27ea1c657 tempest-GroupSnapshotsV319Test-556920773 None] Delete group completed successfully. Jul 08 01:14:14 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-85dd0f20-2dbd-46da-9e59-24a6afa881d2 tempest-VolumeQuotasAdminTestJSON-54305326 None] Transfer volume completed successfully. Jul 08 01:14:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7c24ea04-cef4-42ae-92e7-d93489d25cbc tempest-VolumeQuotasAdminTestJSON-1629994918 None] Acquiring lock "cinder-979303e7-8736-4f33-9dbd-20a3f35ea53b-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7c24ea04-cef4-42ae-92e7-d93489d25cbc tempest-VolumeQuotasAdminTestJSON-1629994918 None] Lock "cinder-979303e7-8736-4f33-9dbd-20a3f35ea53b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7c24ea04-cef4-42ae-92e7-d93489d25cbc tempest-VolumeQuotasAdminTestJSON-1629994918 None] Acquiring lock "cinder-quobyte-979303e7-8736-4f33-9dbd-20a3f35ea53b" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7c24ea04-cef4-42ae-92e7-d93489d25cbc tempest-VolumeQuotasAdminTestJSON-1629994918 None] Lock "cinder-quobyte-979303e7-8736-4f33-9dbd-20a3f35ea53b" acquired by "delete_volume" :: waited 0.026s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:15 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[47de95a8-6b77-458a-bef1-b9b24489cff7]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:14:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7c24ea04-cef4-42ae-92e7-d93489d25cbc tempest-VolumeQuotasAdminTestJSON-1629994918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-979303e7-8736-4f33-9dbd-20a3f35ea53b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:15 devstack sudo[95978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-979303e7-8736-4f33-9dbd-20a3f35ea53b Jul 08 01:14:15 devstack sudo[95978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:16 devstack sudo[95978]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7c24ea04-cef4-42ae-92e7-d93489d25cbc tempest-VolumeQuotasAdminTestJSON-1629994918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-979303e7-8736-4f33-9dbd-20a3f35ea53b" returned: 0 in 1.607s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7c24ea04-cef4-42ae-92e7-d93489d25cbc tempest-VolumeQuotasAdminTestJSON-1629994918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-979303e7-8736-4f33-9dbd-20a3f35ea53b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:16 devstack sudo[95983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-979303e7-8736-4f33-9dbd-20a3f35ea53b Jul 08 01:14:16 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:17 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7c24ea04-cef4-42ae-92e7-d93489d25cbc tempest-VolumeQuotasAdminTestJSON-1629994918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-979303e7-8736-4f33-9dbd-20a3f35ea53b" returned: 0 in 0.796s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:17 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7c24ea04-cef4-42ae-92e7-d93489d25cbc tempest-VolumeQuotasAdminTestJSON-1629994918 None] Lock "cinder-quobyte-979303e7-8736-4f33-9dbd-20a3f35ea53b" released by "delete_volume" :: held 2.462s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:17 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-7c24ea04-cef4-42ae-92e7-d93489d25cbc tempest-VolumeQuotasAdminTestJSON-1629994918 None] Created reservations ['a6255ff4-019e-494f-821a-bd6721340e82', '2e4430f8-4485-48a0-8d1d-1b18221ed4a7', '8681a23e-5fef-431d-be34-0668dda800d0', '10db8e5a-90b4-4d97-b532-356e9c69530b'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:14:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7c24ea04-cef4-42ae-92e7-d93489d25cbc tempest-VolumeQuotasAdminTestJSON-1629994918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7c24ea04-cef4-42ae-92e7-d93489d25cbc tempest-VolumeQuotasAdminTestJSON-1629994918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7c24ea04-cef4-42ae-92e7-d93489d25cbc tempest-VolumeQuotasAdminTestJSON-1629994918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7c24ea04-cef4-42ae-92e7-d93489d25cbc tempest-VolumeQuotasAdminTestJSON-1629994918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7c24ea04-cef4-42ae-92e7-d93489d25cbc tempest-VolumeQuotasAdminTestJSON-1629994918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7c24ea04-cef4-42ae-92e7-d93489d25cbc tempest-VolumeQuotasAdminTestJSON-1629994918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:18 devstack sudo[95987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:14:18 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:18 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:14:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Flow 'volume_create_manager' (cd52085e-07ba-4c88-b0b1-c198f69e8d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c1e00f-dc19-4090-b2b8-00ab12d21a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c1e00f-dc19-4090-b2b8-00ab12d21a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-481495818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf2447f4-afbc-4294-84da-2d1ee2e56f88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda3b4f4678a41c5bc3b9910dab51def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:19Z,use_quota=True,user_id='6328190b6cc548b3a39d11e971e9ea1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddc091fd-1f3a-4b83-888f-70aee458964e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddc091fd-1f3a-4b83-888f-70aee458964e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e839a3-3d6c-413a-98d0-1bc606dd0460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e839a3-3d6c-413a-98d0-1bc606dd0460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf2447f4-afbc-4294-84da-2d1ee2e56f88', 'volume_name': 'volume-cf2447f4-afbc-4294-84da-2d1ee2e56f88', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7dd6f88-b8ed-4f10-a401-9d6e0a95c8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7dd6f88-b8ed-4f10-a401-9d6e0a95c8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b71d57a9-8416-49d9-a78f-e1a1ce489680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:18 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Volume cf2447f4-afbc-4294-84da-2d1ee2e56f88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf2447f4-afbc-4294-84da-2d1ee2e56f88', 'volume_size': 1} Jul 08 01:14:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-481495818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf2447f4-afbc-4294-84da-2d1ee2e56f88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda3b4f4678a41c5bc3b9910dab51def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:19Z,use_quota=True,user_id='6328190b6cc548b3a39d11e971e9ea1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:14:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Creating volume cf2447f4-afbc-4294-84da-2d1ee2e56f88 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:14:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:14:19 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:14:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cf2447f4-afbc-4294-84da-2d1ee2e56f88 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:19 devstack sudo[95989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cf2447f4-afbc-4294-84da-2d1ee2e56f88 1073741824 Jul 08 01:14:19 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:19 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7c24ea04-cef4-42ae-92e7-d93489d25cbc tempest-VolumeQuotasAdminTestJSON-1629994918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.518s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:19 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-7c24ea04-cef4-42ae-92e7-d93489d25cbc tempest-VolumeQuotasAdminTestJSON-1629994918 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:14:19 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-7c24ea04-cef4-42ae-92e7-d93489d25cbc tempest-VolumeQuotasAdminTestJSON-1629994918 None] Deleted volume successfully. Jul 08 01:14:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7c24ea04-cef4-42ae-92e7-d93489d25cbc tempest-VolumeQuotasAdminTestJSON-1629994918 None] Lock "cinder-979303e7-8736-4f33-9dbd-20a3f35ea53b-delete_volume" released by "delete_volume" :: held 4.375s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:20 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cf2447f4-afbc-4294-84da-2d1ee2e56f88 1073741824" returned: 0 in 1.440s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cf2447f4-afbc-4294-84da-2d1ee2e56f88 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:20 devstack sudo[95997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cf2447f4-afbc-4294-84da-2d1ee2e56f88 Jul 08 01:14:20 devstack sudo[95997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:21 devstack sudo[95997]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cf2447f4-afbc-4294-84da-2d1ee2e56f88" returned: 0 in 1.214s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] <== create_volume: return (2707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:14:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.710s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b71d57a9-8416-49d9-a78f-e1a1ce489680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf2447f4-afbc-4294-84da-2d1ee2e56f88', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1bd4ced-d9b7-4aaa-9c82-dd626b8ac91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:21 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Volume volume-cf2447f4-afbc-4294-84da-2d1ee2e56f88 (cf2447f4-afbc-4294-84da-2d1ee2e56f88): created successfully Jul 08 01:14:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1bd4ced-d9b7-4aaa-9c82-dd626b8ac91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Flow 'volume_create_manager' (cd52085e-07ba-4c88-b0b1-c198f69e8d66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:21 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-47ffef5e-4528-4a8a-bd44-6ea206c9b7d1 tempest-VolumesActionsTest-1767978080 None] Created volume successfully. Jul 08 01:14:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b39553cc-ab5a-4967-94f6-060fbda560b9 tempest-VolumesActionsTest-1767978080 None] Acquiring lock "cinder-cf2447f4-afbc-4294-84da-2d1ee2e56f88" by "attach_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b39553cc-ab5a-4967-94f6-060fbda560b9 tempest-VolumesActionsTest-1767978080 None] Lock "cinder-cf2447f4-afbc-4294-84da-2d1ee2e56f88" acquired by "attach_volume" :: waited 0.029s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:22 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-b39553cc-ab5a-4967-94f6-060fbda560b9 tempest-VolumesActionsTest-1767978080 None] Attaching volume cf2447f4-afbc-4294-84da-2d1ee2e56f88 to instance 3dc6496f-058a-4c2b-a461-34bc60fcb03b at mountpoint /dev/vdb on host None. Jul 08 01:14:22 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-b39553cc-ab5a-4967-94f6-060fbda560b9 tempest-VolumesActionsTest-1767978080 None] Attach volume completed successfully. Jul 08 01:14:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b39553cc-ab5a-4967-94f6-060fbda560b9 tempest-VolumesActionsTest-1767978080 None] Lock "cinder-cf2447f4-afbc-4294-84da-2d1ee2e56f88" released by "attach_volume" :: held 0.143s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:23 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:14:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Flow 'volume_create_manager' (c869b377-a9e1-44a1-96f8-20f9b2cc2cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb3d69f-1c34-4b91-8dbb-509d5b02b05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb3d69f-1c34-4b91-8dbb-509d5b02b05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-858173217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db2961d5-1cba-4ea4-9e92-14beaa47ea99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a0426122de46719da0d03091c33fb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:24Z,use_quota=True,user_id='b64d175f4d954c0a84b85ef0af9b3c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07fde404-48c7-4ec2-b4e0-290f778d0359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07fde404-48c7-4ec2-b4e0-290f778d0359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d01fc5-f579-4935-ad72-62869313566b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d01fc5-f579-4935-ad72-62869313566b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db2961d5-1cba-4ea4-9e92-14beaa47ea99', 'volume_name': 'volume-db2961d5-1cba-4ea4-9e92-14beaa47ea99', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a527764-1611-46cd-9fef-c8467e31747d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a527764-1611-46cd-9fef-c8467e31747d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1effdb3e-f262-4def-be90-9d7c95d164eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:23 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Volume db2961d5-1cba-4ea4-9e92-14beaa47ea99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db2961d5-1cba-4ea4-9e92-14beaa47ea99', 'volume_size': 1} Jul 08 01:14:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-858173217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db2961d5-1cba-4ea4-9e92-14beaa47ea99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a0426122de46719da0d03091c33fb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:24Z,use_quota=True,user_id='b64d175f4d954c0a84b85ef0af9b3c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:14:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Creating volume db2961d5-1cba-4ea4-9e92-14beaa47ea99 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:14:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:14:23 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:14:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-db2961d5-1cba-4ea4-9e92-14beaa47ea99 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:23 devstack sudo[96001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-db2961d5-1cba-4ea4-9e92-14beaa47ea99 1073741824 Jul 08 01:14:23 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:23 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-f083985c-4643-4b22-8a6c-54ac58e985b3 tempest-VolumesActionsTest-70982765 None] Terminate volume connection completed successfully. Jul 08 01:14:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f083985c-4643-4b22-8a6c-54ac58e985b3 tempest-VolumesActionsTest-70982765 None] Acquiring lock "cinder-cf2447f4-afbc-4294-84da-2d1ee2e56f88-detach_volume" by "detach_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f083985c-4643-4b22-8a6c-54ac58e985b3 tempest-VolumesActionsTest-70982765 None] Lock "cinder-cf2447f4-afbc-4294-84da-2d1ee2e56f88-detach_volume" acquired by "detach_volume" :: waited 0.051s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:24 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-f083985c-4643-4b22-8a6c-54ac58e985b3 tempest-VolumesActionsTest-70982765 None] Detaching volume cf2447f4-afbc-4294-84da-2d1ee2e56f88 from instance 3dc6496f-058a-4c2b-a461-34bc60fcb03b. Jul 08 01:14:24 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-f083985c-4643-4b22-8a6c-54ac58e985b3 tempest-VolumesActionsTest-70982765 None] Detach volume completed successfully. Jul 08 01:14:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f083985c-4643-4b22-8a6c-54ac58e985b3 tempest-VolumesActionsTest-70982765 None] Lock "cinder-cf2447f4-afbc-4294-84da-2d1ee2e56f88-detach_volume" released by "detach_volume" :: held 0.157s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ebda4fed-36b1-4958-8c05-83e335ddf906 tempest-VolumesActionsTest-1767978080 None] Acquiring lock "cinder-cf2447f4-afbc-4294-84da-2d1ee2e56f88-detach_volume" by "detach_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ebda4fed-36b1-4958-8c05-83e335ddf906 tempest-VolumesActionsTest-1767978080 None] Lock "cinder-cf2447f4-afbc-4294-84da-2d1ee2e56f88-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:25 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-ebda4fed-36b1-4958-8c05-83e335ddf906 tempest-VolumesActionsTest-1767978080 None] Volume detach called, but volume not attached. Jul 08 01:14:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ebda4fed-36b1-4958-8c05-83e335ddf906 tempest-VolumesActionsTest-1767978080 None] Lock "cinder-cf2447f4-afbc-4294-84da-2d1ee2e56f88-detach_volume" released by "detach_volume" :: held 0.033s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:25 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-db2961d5-1cba-4ea4-9e92-14beaa47ea99 1073741824" returned: 0 in 1.624s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-db2961d5-1cba-4ea4-9e92-14beaa47ea99 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:25 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-db2961d5-1cba-4ea4-9e92-14beaa47ea99 Jul 08 01:14:25 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:26 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-46aaf671-1ae8-4789-a101-2b8a93510024 tempest-VolumesActionsTest-1767978080 None] Acquiring lock "cinder-cf2447f4-afbc-4294-84da-2d1ee2e56f88-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:26 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-46aaf671-1ae8-4789-a101-2b8a93510024 tempest-VolumesActionsTest-1767978080 None] Lock "cinder-cf2447f4-afbc-4294-84da-2d1ee2e56f88-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:26 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-46aaf671-1ae8-4789-a101-2b8a93510024 tempest-VolumesActionsTest-1767978080 None] Acquiring lock "cinder-quobyte-cf2447f4-afbc-4294-84da-2d1ee2e56f88" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:26 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-46aaf671-1ae8-4789-a101-2b8a93510024 tempest-VolumesActionsTest-1767978080 None] Lock "cinder-quobyte-cf2447f4-afbc-4294-84da-2d1ee2e56f88" acquired by "delete_volume" :: waited 0.034s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:26 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac736e4-d02b-4e45-9a68-0a743dda72f2]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:14:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-46aaf671-1ae8-4789-a101-2b8a93510024 tempest-VolumesActionsTest-1767978080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cf2447f4-afbc-4294-84da-2d1ee2e56f88 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:26 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cf2447f4-afbc-4294-84da-2d1ee2e56f88 Jul 08 01:14:26 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:26 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-db2961d5-1cba-4ea4-9e92-14beaa47ea99" returned: 0 in 1.353s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:26 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] <== create_volume: return (3068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:14:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.073s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:26 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1effdb3e-f262-4def-be90-9d7c95d164eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db2961d5-1cba-4ea4-9e92-14beaa47ea99', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd029b3-519b-45d4-a9ae-53b5a0e1a833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:27 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Volume volume-db2961d5-1cba-4ea4-9e92-14beaa47ea99 (db2961d5-1cba-4ea4-9e92-14beaa47ea99): created successfully Jul 08 01:14:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd029b3-519b-45d4-a9ae-53b5a0e1a833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Flow 'volume_create_manager' (c869b377-a9e1-44a1-96f8-20f9b2cc2cbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:27 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-81b13e3c-2963-4c66-ae79-ed4530bce220 tempest-VolumesServicesTestJSON-751329040 None] Created volume successfully. Jul 08 01:14:27 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-46aaf671-1ae8-4789-a101-2b8a93510024 tempest-VolumesActionsTest-1767978080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cf2447f4-afbc-4294-84da-2d1ee2e56f88" returned: 0 in 1.284s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-46aaf671-1ae8-4789-a101-2b8a93510024 tempest-VolumesActionsTest-1767978080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cf2447f4-afbc-4294-84da-2d1ee2e56f88 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:27 devstack sudo[96035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cf2447f4-afbc-4294-84da-2d1ee2e56f88 Jul 08 01:14:27 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-230b9fd4-1f55-4add-aedd-b89dfa9539dc tempest-VolumesServicesTestJSON-751329040 None] Acquiring lock "cinder-db2961d5-1cba-4ea4-9e92-14beaa47ea99-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:28 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-46aaf671-1ae8-4789-a101-2b8a93510024 tempest-VolumesActionsTest-1767978080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cf2447f4-afbc-4294-84da-2d1ee2e56f88" returned: 0 in 0.745s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-230b9fd4-1f55-4add-aedd-b89dfa9539dc tempest-VolumesServicesTestJSON-751329040 None] Lock "cinder-db2961d5-1cba-4ea4-9e92-14beaa47ea99-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-46aaf671-1ae8-4789-a101-2b8a93510024 tempest-VolumesActionsTest-1767978080 None] Lock "cinder-quobyte-cf2447f4-afbc-4294-84da-2d1ee2e56f88" released by "delete_volume" :: held 2.100s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:28 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:DELETE=9,cinder:SELECT=85,cinder:INSERT=26,cinder:UPDATE=104 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:14:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-230b9fd4-1f55-4add-aedd-b89dfa9539dc tempest-VolumesServicesTestJSON-751329040 None] Acquiring lock "cinder-quobyte-db2961d5-1cba-4ea4-9e92-14beaa47ea99" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-230b9fd4-1f55-4add-aedd-b89dfa9539dc tempest-VolumesServicesTestJSON-751329040 None] Lock "cinder-quobyte-db2961d5-1cba-4ea4-9e92-14beaa47ea99" acquired by "delete_volume" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:28 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55879a3-0f14-4bae-a8a2-edb913d056a0]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:14:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-230b9fd4-1f55-4add-aedd-b89dfa9539dc tempest-VolumesServicesTestJSON-751329040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-db2961d5-1cba-4ea4-9e92-14beaa47ea99 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:28 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-46aaf671-1ae8-4789-a101-2b8a93510024 tempest-VolumesActionsTest-1767978080 None] Created reservations ['68f5afc8-4006-4f38-8b77-c200ff393bb9', '6f31f393-3e0a-4e51-9b42-678d4766f5b9', 'a1be9f24-b6a1-4804-b7ae-4b04acf93880', '97d138f5-ab77-4ab3-b25a-525ee850f311'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:14:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-46aaf671-1ae8-4789-a101-2b8a93510024 tempest-VolumesActionsTest-1767978080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-46aaf671-1ae8-4789-a101-2b8a93510024 tempest-VolumesActionsTest-1767978080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:28 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-46aaf671-1ae8-4789-a101-2b8a93510024 tempest-VolumesActionsTest-1767978080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:28 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-46aaf671-1ae8-4789-a101-2b8a93510024 tempest-VolumesActionsTest-1767978080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-46aaf671-1ae8-4789-a101-2b8a93510024 tempest-VolumesActionsTest-1767978080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-46aaf671-1ae8-4789-a101-2b8a93510024 tempest-VolumesActionsTest-1767978080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:28 devstack sudo[96038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-db2961d5-1cba-4ea4-9e92-14beaa47ea99 Jul 08 01:14:28 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:28 devstack sudo[96039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:14:28 devstack sudo[96039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:29 devstack sudo[96039]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-46aaf671-1ae8-4789-a101-2b8a93510024 tempest-VolumesActionsTest-1767978080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.793s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:29 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-46aaf671-1ae8-4789-a101-2b8a93510024 tempest-VolumesActionsTest-1767978080 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:14:29 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-46aaf671-1ae8-4789-a101-2b8a93510024 tempest-VolumesActionsTest-1767978080 None] Deleted volume successfully. Jul 08 01:14:29 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-230b9fd4-1f55-4add-aedd-b89dfa9539dc tempest-VolumesServicesTestJSON-751329040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-db2961d5-1cba-4ea4-9e92-14beaa47ea99" returned: 0 in 0.945s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-230b9fd4-1f55-4add-aedd-b89dfa9539dc tempest-VolumesServicesTestJSON-751329040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-db2961d5-1cba-4ea4-9e92-14beaa47ea99 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:29 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-46aaf671-1ae8-4789-a101-2b8a93510024 tempest-VolumesActionsTest-1767978080 None] Lock "cinder-cf2447f4-afbc-4294-84da-2d1ee2e56f88-delete_volume" released by "delete_volume" :: held 3.321s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:29 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-db2961d5-1cba-4ea4-9e92-14beaa47ea99 Jul 08 01:14:29 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:30 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-230b9fd4-1f55-4add-aedd-b89dfa9539dc tempest-VolumesServicesTestJSON-751329040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-db2961d5-1cba-4ea4-9e92-14beaa47ea99" returned: 0 in 0.809s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:30 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-230b9fd4-1f55-4add-aedd-b89dfa9539dc tempest-VolumesServicesTestJSON-751329040 None] Lock "cinder-quobyte-db2961d5-1cba-4ea4-9e92-14beaa47ea99" released by "delete_volume" :: held 1.807s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:30 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-230b9fd4-1f55-4add-aedd-b89dfa9539dc tempest-VolumesServicesTestJSON-751329040 None] Created reservations ['1d324c35-fdcf-4efa-806d-d3d7fd38a519', '754d6d99-8db5-4826-9a42-332960d47f01', '576f3749-815a-478b-93e2-cfff8a21f76d', 'e09743b2-4ec9-4511-b925-d5a4c8d3a61d'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:14:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-230b9fd4-1f55-4add-aedd-b89dfa9539dc tempest-VolumesServicesTestJSON-751329040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-230b9fd4-1f55-4add-aedd-b89dfa9539dc tempest-VolumesServicesTestJSON-751329040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:30 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-230b9fd4-1f55-4add-aedd-b89dfa9539dc tempest-VolumesServicesTestJSON-751329040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:30 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-230b9fd4-1f55-4add-aedd-b89dfa9539dc tempest-VolumesServicesTestJSON-751329040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-230b9fd4-1f55-4add-aedd-b89dfa9539dc tempest-VolumesServicesTestJSON-751329040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-230b9fd4-1f55-4add-aedd-b89dfa9539dc tempest-VolumesServicesTestJSON-751329040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:30 devstack sudo[96049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:14:30 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:31 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:14:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Flow 'volume_create_manager' (9a199ae6-76b4-4cbf-b6ef-1c0715abb260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd85f9e-21b1-43d1-8f8b-1993a00ebed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd85f9e-21b1-43d1-8f8b-1993a00ebed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1087922564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32fef3a9-8092-4845-b847-260547164449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3d2e8d9bf444d6a78f4adc81a17762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:31Z,use_quota=True,user_id='0e5ed7f9dfad41c69084283cb2ef543a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a4893c-dfee-409a-9e62-cc255a1f42f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a4893c-dfee-409a-9e62-cc255a1f42f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a708257d-6501-41ce-929a-7db22eb7a171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a708257d-6501-41ce-929a-7db22eb7a171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32fef3a9-8092-4845-b847-260547164449', 'volume_name': 'volume-32fef3a9-8092-4845-b847-260547164449', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65e22bd3-b845-4cdd-919a-5638f906ad40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65e22bd3-b845-4cdd-919a-5638f906ad40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61abaa4d-71f0-474e-82ee-834aced96c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:31 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Volume 32fef3a9-8092-4845-b847-260547164449: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32fef3a9-8092-4845-b847-260547164449', 'volume_size': 1} Jul 08 01:14:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1087922564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32fef3a9-8092-4845-b847-260547164449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3d2e8d9bf444d6a78f4adc81a17762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:31Z,use_quota=True,user_id='0e5ed7f9dfad41c69084283cb2ef543a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:14:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Creating volume 32fef3a9-8092-4845-b847-260547164449 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:14:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:14:31 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:14:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:31 devstack sudo[96056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449 1073741824 Jul 08 01:14:31 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:31 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-230b9fd4-1f55-4add-aedd-b89dfa9539dc tempest-VolumesServicesTestJSON-751329040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.908s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:31 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-230b9fd4-1f55-4add-aedd-b89dfa9539dc tempest-VolumesServicesTestJSON-751329040 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:14:31 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-230b9fd4-1f55-4add-aedd-b89dfa9539dc tempest-VolumesServicesTestJSON-751329040 None] Deleted volume successfully. Jul 08 01:14:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-230b9fd4-1f55-4add-aedd-b89dfa9539dc tempest-VolumesServicesTestJSON-751329040 None] Lock "cinder-db2961d5-1cba-4ea4-9e92-14beaa47ea99-delete_volume" released by "delete_volume" :: held 3.020s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:32 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449 1073741824" returned: 0 in 1.315s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:32 devstack sudo[96080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449 Jul 08 01:14:32 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:33 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449" returned: 0 in 0.896s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:33 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] <== create_volume: return (2275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:14:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.278s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61abaa4d-71f0-474e-82ee-834aced96c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32fef3a9-8092-4845-b847-260547164449', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d07fc48b-0274-4625-8d34-1ccd9a3dd17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:33 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Volume volume-32fef3a9-8092-4845-b847-260547164449 (32fef3a9-8092-4845-b847-260547164449): created successfully Jul 08 01:14:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d07fc48b-0274-4625-8d34-1ccd9a3dd17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Flow 'volume_create_manager' (9a199ae6-76b4-4cbf-b6ef-1c0715abb260) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:33 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-68dce9f5-72f9-4f47-84dd-6bb5fd18f928 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Created volume successfully. Jul 08 01:14:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5f4af9f2-ed42-4f1e-bbff-22bfb9b21877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5f4af9f2-ed42-4f1e-bbff-22bfb9b21877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:34 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-5f4af9f2-ed42-4f1e-bbff-22bfb9b21877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Creating offline snapshot 4af9a965-d3f8-499c-af1d-4beb0ec2385d of volume 32fef3a9-8092-4845-b847-260547164449 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:14:34 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[287e9ca2-f9bf-4d32-88b2-501d507d831a]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:14:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5f4af9f2-ed42-4f1e-bbff-22bfb9b21877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:34 devstack sudo[96085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449 Jul 08 01:14:34 devstack sudo[96085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:35 devstack sudo[96085]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5f4af9f2-ed42-4f1e-bbff-22bfb9b21877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449" returned: 0 in 0.919s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5f4af9f2-ed42-4f1e-bbff-22bfb9b21877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449.4af9a965-d3f8-499c-af1d-4beb0ec2385d 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:35 devstack sudo[96090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449.4af9a965-d3f8-499c-af1d-4beb0ec2385d 1G Jul 08 01:14:35 devstack sudo[96090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:36 devstack sudo[96090]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5f4af9f2-ed42-4f1e-bbff-22bfb9b21877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449.4af9a965-d3f8-499c-af1d-4beb0ec2385d 1G" returned: 0 in 1.146s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5f4af9f2-ed42-4f1e-bbff-22bfb9b21877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32fef3a9-8092-4845-b847-260547164449 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449.4af9a965-d3f8-499c-af1d-4beb0ec2385d {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:36 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32fef3a9-8092-4845-b847-260547164449 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449.4af9a965-d3f8-499c-af1d-4beb0ec2385d Jul 08 01:14:36 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:37 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5f4af9f2-ed42-4f1e-bbff-22bfb9b21877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32fef3a9-8092-4845-b847-260547164449 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449.4af9a965-d3f8-499c-af1d-4beb0ec2385d" returned: 0 in 0.903s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:37 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-5f4af9f2-ed42-4f1e-bbff-22bfb9b21877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449.4af9a965-d3f8-499c-af1d-4beb0ec2385d is being set with open permissions: ugo+rw Jul 08 01:14:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5f4af9f2-ed42-4f1e-bbff-22bfb9b21877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449.4af9a965-d3f8-499c-af1d-4beb0ec2385d {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:37 devstack sudo[96102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449.4af9a965-d3f8-499c-af1d-4beb0ec2385d Jul 08 01:14:37 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:37 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:14:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Flow 'volume_create_manager' (dc5b95e8-bf72-4b5c-bf50-88c1f5138768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00324245-d71e-4f0f-a9b0-01550b310c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00324245-d71e-4f0f-a9b0-01550b310c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-966020326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d16bebb-130c-4e73-bc94-e3b7059578a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda3b4f4678a41c5bc3b9910dab51def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:38Z,use_quota=True,user_id='6328190b6cc548b3a39d11e971e9ea1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (479c18df-072a-4cf2-9848-3cf06c148acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (479c18df-072a-4cf2-9848-3cf06c148acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd842929-8b78-4b94-99f3-9fd5b01625f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd842929-8b78-4b94-99f3-9fd5b01625f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d16bebb-130c-4e73-bc94-e3b7059578a8', 'volume_name': 'volume-9d16bebb-130c-4e73-bc94-e3b7059578a8', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d35a27-917b-49d7-b133-9fffb1a70914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d35a27-917b-49d7-b133-9fffb1a70914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (323d4c6f-7b29-4ecd-a1aa-f5bf3816b0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:38 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Volume 9d16bebb-130c-4e73-bc94-e3b7059578a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d16bebb-130c-4e73-bc94-e3b7059578a8', 'volume_size': 1} Jul 08 01:14:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:38 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5f4af9f2-ed42-4f1e-bbff-22bfb9b21877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449.4af9a965-d3f8-499c-af1d-4beb0ec2385d" returned: 0 in 0.860s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5f4af9f2-ed42-4f1e-bbff-22bfb9b21877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:38 devstack sudo[96105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449.info Jul 08 01:14:38 devstack sudo[96105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:39 devstack sudo[96105]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5f4af9f2-ed42-4f1e-bbff-22bfb9b21877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449.info" returned: 0 in 0.719s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:39 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-5f4af9f2-ed42-4f1e-bbff-22bfb9b21877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449.info is being set with open permissions: ugo+rw Jul 08 01:14:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5f4af9f2-ed42-4f1e-bbff-22bfb9b21877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:39 devstack sudo[96108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449.info Jul 08 01:14:39 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:39 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5f4af9f2-ed42-4f1e-bbff-22bfb9b21877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449.info" returned: 0 in 0.721s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5f4af9f2-ed42-4f1e-bbff-22bfb9b21877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.376s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.828s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:39 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-966020326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d16bebb-130c-4e73-bc94-e3b7059578a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda3b4f4678a41c5bc3b9910dab51def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:38Z,use_quota=True,user_id='6328190b6cc548b3a39d11e971e9ea1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:14:39 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Creating volume 9d16bebb-130c-4e73-bc94-e3b7059578a8 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:14:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:39 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:39 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:39 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:14:39 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:14:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9d16bebb-130c-4e73-bc94-e3b7059578a8 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:40 devstack sudo[96111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9d16bebb-130c-4e73-bc94-e3b7059578a8 1073741824 Jul 08 01:14:40 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:40 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-5f4af9f2-ed42-4f1e-bbff-22bfb9b21877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Create snapshot completed successfully Jul 08 01:14:41 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9d16bebb-130c-4e73-bc94-e3b7059578a8 1073741824" returned: 0 in 1.087s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9d16bebb-130c-4e73-bc94-e3b7059578a8 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:41 devstack sudo[96117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9d16bebb-130c-4e73-bc94-e3b7059578a8 Jul 08 01:14:41 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:41 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b225f8d5-7cd5-401f-97a0-6759afe5eaea tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Acquiring lock "cinder-4af9a965-d3f8-499c-af1d-4beb0ec2385d-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:41 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b225f8d5-7cd5-401f-97a0-6759afe5eaea tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Lock "cinder-4af9a965-d3f8-499c-af1d-4beb0ec2385d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:41 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b225f8d5-7cd5-401f-97a0-6759afe5eaea tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Acquiring lock "cinder-quobyte-32fef3a9-8092-4845-b847-260547164449" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:41 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b225f8d5-7cd5-401f-97a0-6759afe5eaea tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Lock "cinder-quobyte-32fef3a9-8092-4845-b847-260547164449" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:41 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b225f8d5-7cd5-401f-97a0-6759afe5eaea tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Acquiring lock "cinder-quobyte-4af9a965-d3f8-499c-af1d-4beb0ec2385d" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:41 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b225f8d5-7cd5-401f-97a0-6759afe5eaea tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Lock "cinder-quobyte-4af9a965-d3f8-499c-af1d-4beb0ec2385d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:41 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-b225f8d5-7cd5-401f-97a0-6759afe5eaea tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Deleting offline snapshot 4af9a965-d3f8-499c-af1d-4beb0ec2385d of volume 32fef3a9-8092-4845-b847-260547164449 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:14:41 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-b225f8d5-7cd5-401f-97a0-6759afe5eaea tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] snapshot_file for this snap is: volume-32fef3a9-8092-4845-b847-260547164449.4af9a965-d3f8-499c-af1d-4beb0ec2385d {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:14:41 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09feddd-e325-44c0-90b4-f479e2935bc8]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:14:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b225f8d5-7cd5-401f-97a0-6759afe5eaea tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449.4af9a965-d3f8-499c-af1d-4beb0ec2385d {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:41 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9d16bebb-130c-4e73-bc94-e3b7059578a8" returned: 0 in 0.785s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:41 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:14:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:41 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (323d4c6f-7b29-4ecd-a1aa-f5bf3816b0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d16bebb-130c-4e73-bc94-e3b7059578a8', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:41 devstack sudo[96120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449.4af9a965-d3f8-499c-af1d-4beb0ec2385d Jul 08 01:14:41 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:41 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93151fe-97d0-4fcc-97e3-61eba70fb86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:41 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Volume volume-9d16bebb-130c-4e73-bc94-e3b7059578a8 (9d16bebb-130c-4e73-bc94-e3b7059578a8): created successfully Jul 08 01:14:41 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93151fe-97d0-4fcc-97e3-61eba70fb86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:41 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Flow 'volume_create_manager' (dc5b95e8-bf72-4b5c-bf50-88c1f5138768) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:41 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-302cc85e-f856-4933-9ce3-6d96702ccaeb tempest-VolumesActionsTest-1767978080 None] Created volume successfully. Jul 08 01:14:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f7ae2092-3d65-4696-9750-49ab7b212ade tempest-VolumesActionsTest-70982765 None] Acquiring lock "cinder-9d16bebb-130c-4e73-bc94-e3b7059578a8-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f7ae2092-3d65-4696-9750-49ab7b212ade tempest-VolumesActionsTest-70982765 None] Lock "cinder-9d16bebb-130c-4e73-bc94-e3b7059578a8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f7ae2092-3d65-4696-9750-49ab7b212ade tempest-VolumesActionsTest-70982765 None] Acquiring lock "cinder-quobyte-9d16bebb-130c-4e73-bc94-e3b7059578a8" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f7ae2092-3d65-4696-9750-49ab7b212ade tempest-VolumesActionsTest-70982765 None] Lock "cinder-quobyte-9d16bebb-130c-4e73-bc94-e3b7059578a8" acquired by "delete_volume" :: waited 0.025s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:42 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[840cb49a-963e-4d54-a6f9-23f231d43666]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:14:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f7ae2092-3d65-4696-9750-49ab7b212ade tempest-VolumesActionsTest-70982765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9d16bebb-130c-4e73-bc94-e3b7059578a8 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:42 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b225f8d5-7cd5-401f-97a0-6759afe5eaea tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449.4af9a965-d3f8-499c-af1d-4beb0ec2385d" returned: 0 in 0.996s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:42 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-b225f8d5-7cd5-401f-97a0-6759afe5eaea tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32fef3a9-8092-4845-b847-260547164449(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:14:42 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b26a158-3a5c-4765-b346-2fd72201a39a]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:14:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b225f8d5-7cd5-401f-97a0-6759afe5eaea tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:42 devstack sudo[96125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9d16bebb-130c-4e73-bc94-e3b7059578a8 Jul 08 01:14:42 devstack sudo[96125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:42 devstack sudo[96126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449 Jul 08 01:14:42 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:43 devstack sudo[96125]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f7ae2092-3d65-4696-9750-49ab7b212ade tempest-VolumesActionsTest-70982765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9d16bebb-130c-4e73-bc94-e3b7059578a8" returned: 0 in 1.022s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f7ae2092-3d65-4696-9750-49ab7b212ade tempest-VolumesActionsTest-70982765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9d16bebb-130c-4e73-bc94-e3b7059578a8 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:43 devstack sudo[96135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9d16bebb-130c-4e73-bc94-e3b7059578a8 Jul 08 01:14:43 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:43 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b225f8d5-7cd5-401f-97a0-6759afe5eaea tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449" returned: 0 in 1.083s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b225f8d5-7cd5-401f-97a0-6759afe5eaea tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449.4af9a965-d3f8-499c-af1d-4beb0ec2385d {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:43 devstack sudo[96137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449.4af9a965-d3f8-499c-af1d-4beb0ec2385d Jul 08 01:14:43 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:44 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f7ae2092-3d65-4696-9750-49ab7b212ade tempest-VolumesActionsTest-70982765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9d16bebb-130c-4e73-bc94-e3b7059578a8" returned: 0 in 0.857s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:44 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f7ae2092-3d65-4696-9750-49ab7b212ade tempest-VolumesActionsTest-70982765 None] Lock "cinder-quobyte-9d16bebb-130c-4e73-bc94-e3b7059578a8" released by "delete_volume" :: held 1.949s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:44 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-f7ae2092-3d65-4696-9750-49ab7b212ade tempest-VolumesActionsTest-70982765 None] Created reservations ['241b02a5-bb2d-4e1d-bf04-cde566603a4c', '1fff7f37-3a7e-4629-b77f-d3eb69e26cc4', 'a29fc040-62f7-40ac-a537-6125b5c8b820', '52ebf4af-9e0e-43dc-93a4-eec958416880'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:14:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f7ae2092-3d65-4696-9750-49ab7b212ade tempest-VolumesActionsTest-70982765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f7ae2092-3d65-4696-9750-49ab7b212ade tempest-VolumesActionsTest-70982765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f7ae2092-3d65-4696-9750-49ab7b212ade tempest-VolumesActionsTest-70982765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f7ae2092-3d65-4696-9750-49ab7b212ade tempest-VolumesActionsTest-70982765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f7ae2092-3d65-4696-9750-49ab7b212ade tempest-VolumesActionsTest-70982765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f7ae2092-3d65-4696-9750-49ab7b212ade tempest-VolumesActionsTest-70982765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:44 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:14:44 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:44 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b225f8d5-7cd5-401f-97a0-6759afe5eaea tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449.4af9a965-d3f8-499c-af1d-4beb0ec2385d" returned: 0 in 1.072s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b225f8d5-7cd5-401f-97a0-6759afe5eaea tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449.4af9a965-d3f8-499c-af1d-4beb0ec2385d {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:45 devstack sudo[96145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449.4af9a965-d3f8-499c-af1d-4beb0ec2385d Jul 08 01:14:45 devstack sudo[96145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:45 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:14:45 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:14:45 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Flow 'volume_create_manager' (dfa42443-c8a2-4833-86ad-5f6b73a14b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a072855d-07f9-4380-9dcb-de04a73a79ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f7ae2092-3d65-4696-9750-49ab7b212ade tempest-VolumesActionsTest-70982765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.103s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-f7ae2092-3d65-4696-9750-49ab7b212ade tempest-VolumesActionsTest-70982765 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a072855d-07f9-4380-9dcb-de04a73a79ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2046555659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f86f46f2-d9b7-4efa-8d2f-204c3e282112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda3b4f4678a41c5bc3b9910dab51def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:46Z,use_quota=True,user_id='6328190b6cc548b3a39d11e971e9ea1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f9c10f-3729-4f1e-82d6-f81f4150cf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f9c10f-3729-4f1e-82d6-f81f4150cf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9ff320-6a0f-4338-8019-8a6394a6ce47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9ff320-6a0f-4338-8019-8a6394a6ce47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f86f46f2-d9b7-4efa-8d2f-204c3e282112', 'volume_name': 'volume-f86f46f2-d9b7-4efa-8d2f-204c3e282112', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10513218-2728-4172-86d8-5d63c2cf40c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10513218-2728-4172-86d8-5d63c2cf40c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a8676b-377e-429c-825b-8c4d74f2d77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:45 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Volume f86f46f2-d9b7-4efa-8d2f-204c3e282112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f86f46f2-d9b7-4efa-8d2f-204c3e282112', 'volume_size': 1} Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2046555659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f86f46f2-d9b7-4efa-8d2f-204c3e282112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda3b4f4678a41c5bc3b9910dab51def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:46Z,use_quota=True,user_id='6328190b6cc548b3a39d11e971e9ea1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Creating volume f86f46f2-d9b7-4efa-8d2f-204c3e282112 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:14:46 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:14:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f86f46f2-d9b7-4efa-8d2f-204c3e282112 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:46 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-f7ae2092-3d65-4696-9750-49ab7b212ade tempest-VolumesActionsTest-70982765 None] Deleted volume successfully. Jul 08 01:14:46 devstack sudo[96151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f86f46f2-d9b7-4efa-8d2f-204c3e282112 1073741824 Jul 08 01:14:46 devstack sudo[96151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:46 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f7ae2092-3d65-4696-9750-49ab7b212ade tempest-VolumesActionsTest-70982765 None] Lock "cinder-9d16bebb-130c-4e73-bc94-e3b7059578a8-delete_volume" released by "delete_volume" :: held 3.485s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:46 devstack sudo[96145]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b225f8d5-7cd5-401f-97a0-6759afe5eaea tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449.4af9a965-d3f8-499c-af1d-4beb0ec2385d" returned: 0 in 1.242s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:46 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b225f8d5-7cd5-401f-97a0-6759afe5eaea tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Lock "cinder-quobyte-4af9a965-d3f8-499c-af1d-4beb0ec2385d" released by "_delete_snapshot" :: held 4.574s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:46 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b225f8d5-7cd5-401f-97a0-6759afe5eaea tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Lock "cinder-quobyte-32fef3a9-8092-4845-b847-260547164449" released by "delete_snapshot" :: held 4.616s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:46 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-b225f8d5-7cd5-401f-97a0-6759afe5eaea tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Created reservations ['b0d58e0f-2806-42b2-af6a-31e548864e04', '7ffb87ad-2c0a-4fde-bbb7-12a4d1d08410', '1deefbab-ad3d-4c52-83d6-6c3a4f2e6e8b', 'bc7e68a8-d6fa-454b-b00d-24e8efdd5d4f'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:14:46 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-b225f8d5-7cd5-401f-97a0-6759afe5eaea tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Delete snapshot completed successfully. Jul 08 01:14:46 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b225f8d5-7cd5-401f-97a0-6759afe5eaea tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Lock "cinder-4af9a965-d3f8-499c-af1d-4beb0ec2385d-delete_snapshot" released by "delete_snapshot" :: held 4.826s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:46 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.369s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:46 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:14:46 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:14:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread count: 8 {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:14:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread info: [<_MainThread(MainThread, started 134382216167552)>, , , , , , , ] {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:14:47 devstack sudo[96151]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4df47d7a-a13d-41b4-9369-f9342880d8e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Acquiring lock "cinder-32fef3a9-8092-4845-b847-260547164449-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f86f46f2-d9b7-4efa-8d2f-204c3e282112 1073741824" returned: 0 in 1.098s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4df47d7a-a13d-41b4-9369-f9342880d8e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Lock "cinder-32fef3a9-8092-4845-b847-260547164449-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f86f46f2-d9b7-4efa-8d2f-204c3e282112 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4df47d7a-a13d-41b4-9369-f9342880d8e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Acquiring lock "cinder-quobyte-32fef3a9-8092-4845-b847-260547164449" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:47 devstack sudo[96158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f86f46f2-d9b7-4efa-8d2f-204c3e282112 Jul 08 01:14:47 devstack sudo[96158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4df47d7a-a13d-41b4-9369-f9342880d8e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Lock "cinder-quobyte-32fef3a9-8092-4845-b847-260547164449" acquired by "delete_volume" :: waited 0.028s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[945f95ca-fb9b-48af-9379-dd721c545578]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4df47d7a-a13d-41b4-9369-f9342880d8e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:47 devstack sudo[96161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449 Jul 08 01:14:47 devstack sudo[96161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Flow 'volume_create_manager' (37d0a748-9963-40bf-badc-cc94344795ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd3b05cb-2919-4ff4-af24-e42f652c8990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd3b05cb-2919-4ff4-af24-e42f652c8990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-513113645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd95fc22-674d-4035-bb57-de71b16e19d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae37259daf8460bb8b5836e8e396fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:48Z,use_quota=True,user_id='daa93070623c4ace89e386a4554ff0c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6f70795-e1a3-444e-9f33-6b7fdbb24b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6f70795-e1a3-444e-9f33-6b7fdbb24b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0007467f-15d4-4a94-8fce-dfc175afb221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0007467f-15d4-4a94-8fce-dfc175afb221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd95fc22-674d-4035-bb57-de71b16e19d0', 'volume_name': 'volume-fd95fc22-674d-4035-bb57-de71b16e19d0', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93bf3983-b83b-4b26-8d25-a63b746eb77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93bf3983-b83b-4b26-8d25-a63b746eb77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2206241-695e-453b-8bbe-53866f54cdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:47 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Volume fd95fc22-674d-4035-bb57-de71b16e19d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd95fc22-674d-4035-bb57-de71b16e19d0', 'volume_size': 1} Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:47 devstack sudo[96158]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f86f46f2-d9b7-4efa-8d2f-204c3e282112" returned: 0 in 0.814s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] <== create_volume: return (2012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.017s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.268s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-513113645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd95fc22-674d-4035-bb57-de71b16e19d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae37259daf8460bb8b5836e8e396fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:48Z,use_quota=True,user_id='daa93070623c4ace89e386a4554ff0c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Creating volume fd95fc22-674d-4035-bb57-de71b16e19d0 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:14:47 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:14:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:48 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a8676b-377e-429c-825b-8c4d74f2d77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f86f46f2-d9b7-4efa-8d2f-204c3e282112', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:48 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0 1073741824 Jul 08 01:14:48 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:48 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dbcb4f5-c2b7-42bd-840d-91a432419428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:48 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Volume volume-f86f46f2-d9b7-4efa-8d2f-204c3e282112 (f86f46f2-d9b7-4efa-8d2f-204c3e282112): created successfully Jul 08 01:14:48 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dbcb4f5-c2b7-42bd-840d-91a432419428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:48 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Flow 'volume_create_manager' (dfa42443-c8a2-4833-86ad-5f6b73a14b60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:48 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-42c06b35-98a1-4f5e-b3eb-fce255e93d25 tempest-VolumesActionsTest-1767978080 None] Created volume successfully. Jul 08 01:14:48 devstack sudo[96161]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4df47d7a-a13d-41b4-9369-f9342880d8e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449" returned: 0 in 0.965s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4df47d7a-a13d-41b4-9369-f9342880d8e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:48 devstack sudo[96169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449 Jul 08 01:14:48 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:49 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4df47d7a-a13d-41b4-9369-f9342880d8e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-32fef3a9-8092-4845-b847-260547164449" returned: 0 in 0.740s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:49 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0 1073741824" returned: 0 in 1.043s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:49 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4df47d7a-a13d-41b4-9369-f9342880d8e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Lock "cinder-quobyte-32fef3a9-8092-4845-b847-260547164449" released by "delete_volume" :: held 1.824s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:49 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0 Jul 08 01:14:49 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:49 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-4df47d7a-a13d-41b4-9369-f9342880d8e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Created reservations ['169680b2-2d2a-445d-a513-e8c9b6983b81', '56eab339-1a07-4748-ac21-1717a1a4add3', '6accfad0-1f43-4a75-9562-cbc3027bb681', 'fd8c485a-68ca-435a-99d4-60f1d1b8da45'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:14:49 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-fc8b3d75-55a4-4742-8285-acc82f4bf30b tempest-VolumesActionsTest-70982765 None] Acquiring lock "cinder-f86f46f2-d9b7-4efa-8d2f-204c3e282112-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:49 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-fc8b3d75-55a4-4742-8285-acc82f4bf30b tempest-VolumesActionsTest-70982765 None] Lock "cinder-f86f46f2-d9b7-4efa-8d2f-204c3e282112-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4df47d7a-a13d-41b4-9369-f9342880d8e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4df47d7a-a13d-41b4-9369-f9342880d8e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:49 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4df47d7a-a13d-41b4-9369-f9342880d8e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:49 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4df47d7a-a13d-41b4-9369-f9342880d8e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4df47d7a-a13d-41b4-9369-f9342880d8e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4df47d7a-a13d-41b4-9369-f9342880d8e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:49 devstack sudo[96178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:14:49 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:49 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-fc8b3d75-55a4-4742-8285-acc82f4bf30b tempest-VolumesActionsTest-70982765 None] Acquiring lock "cinder-quobyte-f86f46f2-d9b7-4efa-8d2f-204c3e282112" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:49 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-fc8b3d75-55a4-4742-8285-acc82f4bf30b tempest-VolumesActionsTest-70982765 None] Lock "cinder-quobyte-f86f46f2-d9b7-4efa-8d2f-204c3e282112" acquired by "delete_volume" :: waited 0.034s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:49 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ee70c0-1099-4bfa-88da-ce0d0337f033]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:14:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fc8b3d75-55a4-4742-8285-acc82f4bf30b tempest-VolumesActionsTest-70982765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f86f46f2-d9b7-4efa-8d2f-204c3e282112 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:49 devstack sudo[96180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f86f46f2-d9b7-4efa-8d2f-204c3e282112 Jul 08 01:14:49 devstack sudo[96180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:50 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0" returned: 0 in 1.025s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:50 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] <== create_volume: return (2146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:14:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.149s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:50 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2206241-695e-453b-8bbe-53866f54cdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd95fc22-674d-4035-bb57-de71b16e19d0', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:50 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7db039e-3ae9-408f-a370-9cee8302b192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:50 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Volume volume-fd95fc22-674d-4035-bb57-de71b16e19d0 (fd95fc22-674d-4035-bb57-de71b16e19d0): created successfully Jul 08 01:14:50 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7db039e-3ae9-408f-a370-9cee8302b192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:50 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Flow 'volume_create_manager' (37d0a748-9963-40bf-badc-cc94344795ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:50 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-a19ba352-fe9e-4c5e-addc-3331142428b6 tempest-SnapshotMetadataTestJSON-179050274 None] Created volume successfully. Jul 08 01:14:50 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4df47d7a-a13d-41b4-9369-f9342880d8e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.107s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:50 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-4df47d7a-a13d-41b4-9369-f9342880d8e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:14:50 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-4df47d7a-a13d-41b4-9369-f9342880d8e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Deleted volume successfully. Jul 08 01:14:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4df47d7a-a13d-41b4-9369-f9342880d8e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913236945 None] Lock "cinder-32fef3a9-8092-4845-b847-260547164449-delete_volume" released by "delete_volume" :: held 3.349s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:50 devstack sudo[96180]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fc8b3d75-55a4-4742-8285-acc82f4bf30b tempest-VolumesActionsTest-70982765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f86f46f2-d9b7-4efa-8d2f-204c3e282112" returned: 0 in 1.131s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fc8b3d75-55a4-4742-8285-acc82f4bf30b tempest-VolumesActionsTest-70982765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f86f46f2-d9b7-4efa-8d2f-204c3e282112 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:50 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f86f46f2-d9b7-4efa-8d2f-204c3e282112 Jul 08 01:14:50 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-150c8ea3-bd6b-473f-969b-5306d3322a70 tempest-SnapshotMetadataTestJSON-179050274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-150c8ea3-bd6b-473f-969b-5306d3322a70 tempest-SnapshotMetadataTestJSON-179050274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:51 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-150c8ea3-bd6b-473f-969b-5306d3322a70 tempest-SnapshotMetadataTestJSON-179050274 None] Creating offline snapshot 4fe77fec-799f-4a4a-8421-2ad77960957b of volume fd95fc22-674d-4035-bb57-de71b16e19d0 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:14:51 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf19b68-a661-4669-9d29-e4a7d4f63bc6]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:14:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-150c8ea3-bd6b-473f-969b-5306d3322a70 tempest-SnapshotMetadataTestJSON-179050274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:51 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0 Jul 08 01:14:51 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:51 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fc8b3d75-55a4-4742-8285-acc82f4bf30b tempest-VolumesActionsTest-70982765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f86f46f2-d9b7-4efa-8d2f-204c3e282112" returned: 0 in 0.933s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:51 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-fc8b3d75-55a4-4742-8285-acc82f4bf30b tempest-VolumesActionsTest-70982765 None] Lock "cinder-quobyte-f86f46f2-d9b7-4efa-8d2f-204c3e282112" released by "delete_volume" :: held 2.146s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:51 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-fc8b3d75-55a4-4742-8285-acc82f4bf30b tempest-VolumesActionsTest-70982765 None] Created reservations ['cc85f0ec-dfd8-4aa1-825c-89e4e78999d7', 'e49dd27f-362b-4047-8d91-d41daf3427f6', 'a2356cfd-b881-4272-85dd-f95b507af5dc', '90876944-1749-4f1d-8779-a9b791407399'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:14:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-fc8b3d75-55a4-4742-8285-acc82f4bf30b tempest-VolumesActionsTest-70982765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-fc8b3d75-55a4-4742-8285-acc82f4bf30b tempest-VolumesActionsTest-70982765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:51 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-fc8b3d75-55a4-4742-8285-acc82f4bf30b tempest-VolumesActionsTest-70982765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:51 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-fc8b3d75-55a4-4742-8285-acc82f4bf30b tempest-VolumesActionsTest-70982765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-fc8b3d75-55a4-4742-8285-acc82f4bf30b tempest-VolumesActionsTest-70982765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fc8b3d75-55a4-4742-8285-acc82f4bf30b tempest-VolumesActionsTest-70982765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:51 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:14:51 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:52 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-150c8ea3-bd6b-473f-969b-5306d3322a70 tempest-SnapshotMetadataTestJSON-179050274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0" returned: 0 in 1.206s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-150c8ea3-bd6b-473f-969b-5306d3322a70 tempest-SnapshotMetadataTestJSON-179050274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0.4fe77fec-799f-4a4a-8421-2ad77960957b 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:52 devstack sudo[96197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0.4fe77fec-799f-4a4a-8421-2ad77960957b 1G Jul 08 01:14:52 devstack sudo[96197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:52 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fc8b3d75-55a4-4742-8285-acc82f4bf30b tempest-VolumesActionsTest-70982765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.088s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:52 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-fc8b3d75-55a4-4742-8285-acc82f4bf30b tempest-VolumesActionsTest-70982765 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:14:52 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-fc8b3d75-55a4-4742-8285-acc82f4bf30b tempest-VolumesActionsTest-70982765 None] Deleted volume successfully. Jul 08 01:14:52 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-fc8b3d75-55a4-4742-8285-acc82f4bf30b tempest-VolumesActionsTest-70982765 None] Lock "cinder-f86f46f2-d9b7-4efa-8d2f-204c3e282112-delete_volume" released by "delete_volume" :: held 3.650s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:53 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:14:53 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Flow 'volume_create_manager' (e7944282-985c-4155-b389-f16a7d0f2b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:53 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cd72055-835d-49b6-9a34-51185480e56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:53 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cd72055-835d-49b6-9a34-51185480e56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1475627751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad4e28d2-cc47-49c5-8a11-48564b78374e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda3b4f4678a41c5bc3b9910dab51def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:54Z,use_quota=True,user_id='6328190b6cc548b3a39d11e971e9ea1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:53 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cceca59-850f-4736-8c5a-fe1fba79f920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:53 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cceca59-850f-4736-8c5a-fe1fba79f920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:53 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee892b66-9efb-4005-a0c8-1754d9ca7286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:53 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee892b66-9efb-4005-a0c8-1754d9ca7286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad4e28d2-cc47-49c5-8a11-48564b78374e', 'volume_name': 'volume-ad4e28d2-cc47-49c5-8a11-48564b78374e', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:53 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86cd9057-d628-4db0-be08-b35ebc96c2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:53 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86cd9057-d628-4db0-be08-b35ebc96c2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:53 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ede62a-d714-4ede-8049-422a97d92f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:53 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Volume ad4e28d2-cc47-49c5-8a11-48564b78374e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad4e28d2-cc47-49c5-8a11-48564b78374e', 'volume_size': 1} Jul 08 01:14:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:53 devstack sudo[96197]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-150c8ea3-bd6b-473f-969b-5306d3322a70 tempest-SnapshotMetadataTestJSON-179050274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0.4fe77fec-799f-4a4a-8421-2ad77960957b 1G" returned: 0 in 1.424s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-150c8ea3-bd6b-473f-969b-5306d3322a70 tempest-SnapshotMetadataTestJSON-179050274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd95fc22-674d-4035-bb57-de71b16e19d0 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0.4fe77fec-799f-4a4a-8421-2ad77960957b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:53 devstack sudo[96203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd95fc22-674d-4035-bb57-de71b16e19d0 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0.4fe77fec-799f-4a4a-8421-2ad77960957b Jul 08 01:14:53 devstack sudo[96203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:54 devstack sudo[96203]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-150c8ea3-bd6b-473f-969b-5306d3322a70 tempest-SnapshotMetadataTestJSON-179050274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd95fc22-674d-4035-bb57-de71b16e19d0 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0.4fe77fec-799f-4a4a-8421-2ad77960957b" returned: 0 in 0.807s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:54 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-150c8ea3-bd6b-473f-969b-5306d3322a70 tempest-SnapshotMetadataTestJSON-179050274 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0.4fe77fec-799f-4a4a-8421-2ad77960957b is being set with open permissions: ugo+rw Jul 08 01:14:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-150c8ea3-bd6b-473f-969b-5306d3322a70 tempest-SnapshotMetadataTestJSON-179050274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0.4fe77fec-799f-4a4a-8421-2ad77960957b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:54 devstack sudo[96209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0.4fe77fec-799f-4a4a-8421-2ad77960957b Jul 08 01:14:54 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:55 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-150c8ea3-bd6b-473f-969b-5306d3322a70 tempest-SnapshotMetadataTestJSON-179050274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0.4fe77fec-799f-4a4a-8421-2ad77960957b" returned: 0 in 0.709s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-150c8ea3-bd6b-473f-969b-5306d3322a70 tempest-SnapshotMetadataTestJSON-179050274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:55 devstack sudo[96212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0.info Jul 08 01:14:55 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:56 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-150c8ea3-bd6b-473f-969b-5306d3322a70 tempest-SnapshotMetadataTestJSON-179050274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0.info" returned: 0 in 0.727s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:56 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-150c8ea3-bd6b-473f-969b-5306d3322a70 tempest-SnapshotMetadataTestJSON-179050274 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0.info is being set with open permissions: ugo+rw Jul 08 01:14:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-150c8ea3-bd6b-473f-969b-5306d3322a70 tempest-SnapshotMetadataTestJSON-179050274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:56 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0.info Jul 08 01:14:56 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:56 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-150c8ea3-bd6b-473f-969b-5306d3322a70 tempest-SnapshotMetadataTestJSON-179050274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0.info" returned: 0 in 0.745s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-150c8ea3-bd6b-473f-969b-5306d3322a70 tempest-SnapshotMetadataTestJSON-179050274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.752s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.167s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:56 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1475627751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad4e28d2-cc47-49c5-8a11-48564b78374e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda3b4f4678a41c5bc3b9910dab51def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:54Z,use_quota=True,user_id='6328190b6cc548b3a39d11e971e9ea1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:14:56 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Creating volume ad4e28d2-cc47-49c5-8a11-48564b78374e {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:14:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:56 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:56 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:56 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:14:56 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:14:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ad4e28d2-cc47-49c5-8a11-48564b78374e 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:56 devstack sudo[96218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ad4e28d2-cc47-49c5-8a11-48564b78374e 1073741824 Jul 08 01:14:56 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:56 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-150c8ea3-bd6b-473f-969b-5306d3322a70 tempest-SnapshotMetadataTestJSON-179050274 None] Create snapshot completed successfully Jul 08 01:14:57 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:14:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Flow 'volume_create_manager' (ee7f85cb-8496-4eb1-b1a7-37f342105ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf924190-04b2-4bce-bed7-2f8f8dc0e9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf924190-04b2-4bce-bed7-2f8f8dc0e9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-604321148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd1a67b-9801-4479-ae75-c797040d9116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1ed405951ad446790116e7f1f9a1f7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:58Z,use_quota=True,user_id='864ead09be0346b6a47876bb5d9803d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8abd3fcd-552b-46d8-aa35-3cbda6aa883c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8abd3fcd-552b-46d8-aa35-3cbda6aa883c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d1d5a1-9a58-4f23-8f44-5262e7d1a54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d1d5a1-9a58-4f23-8f44-5262e7d1a54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cd1a67b-9801-4479-ae75-c797040d9116', 'volume_name': 'volume-3cd1a67b-9801-4479-ae75-c797040d9116', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3b27dc9-6c27-467d-9ef4-b3f75de0e525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3b27dc9-6c27-467d-9ef4-b3f75de0e525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d70dfd4-4309-4858-ad91-a51998957dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:57 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Volume 3cd1a67b-9801-4479-ae75-c797040d9116: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cd1a67b-9801-4479-ae75-c797040d9116', 'volume_size': 1} Jul 08 01:14:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:57 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:14:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Flow 'volume_create_manager' (886fe51f-97b4-4f02-a89f-49e3c529dcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c13b9949-47e0-47b9-847b-2a7cf666be74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c13b9949-47e0-47b9-847b-2a7cf666be74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1012992157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8673479-9a05-4eee-b7bc-5e7fb266a843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8953228fcc4e16b525c02638da6b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:58Z,use_quota=True,user_id='0d1b372cd0da4116a60f3a2d1346e15f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c19afca2-7c00-4d45-b7a1-74b86da50955),volume_type_id=c19afca2-7c00-4d45-b7a1-74b86da50955)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed318dc-bdb6-46c5-b0e5-a7a342899019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed318dc-bdb6-46c5-b0e5-a7a342899019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f053e00-5c90-49f6-a9de-7af2ea91e3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f053e00-5c90-49f6-a9de-7af2ea91e3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8673479-9a05-4eee-b7bc-5e7fb266a843', 'volume_name': 'volume-d8673479-9a05-4eee-b7bc-5e7fb266a843', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e928df0-8b1e-402e-b08b-3b4401369648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e928df0-8b1e-402e-b08b-3b4401369648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84cb3995-b389-496e-9e05-a750e16a240d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:57 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Volume d8673479-9a05-4eee-b7bc-5e7fb266a843: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8673479-9a05-4eee-b7bc-5e7fb266a843', 'volume_size': 1} Jul 08 01:14:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:58 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ad4e28d2-cc47-49c5-8a11-48564b78374e 1073741824" returned: 0 in 1.124s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ad4e28d2-cc47-49c5-8a11-48564b78374e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:58 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ad4e28d2-cc47-49c5-8a11-48564b78374e Jul 08 01:14:58 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-615ebc38-bf35-46f2-9e42-bee3a41f87c7 tempest-SnapshotMetadataTestJSON-179050274 None] Acquiring lock "cinder-4fe77fec-799f-4a4a-8421-2ad77960957b-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-615ebc38-bf35-46f2-9e42-bee3a41f87c7 tempest-SnapshotMetadataTestJSON-179050274 None] Lock "cinder-4fe77fec-799f-4a4a-8421-2ad77960957b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-615ebc38-bf35-46f2-9e42-bee3a41f87c7 tempest-SnapshotMetadataTestJSON-179050274 None] Acquiring lock "cinder-quobyte-fd95fc22-674d-4035-bb57-de71b16e19d0" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-615ebc38-bf35-46f2-9e42-bee3a41f87c7 tempest-SnapshotMetadataTestJSON-179050274 None] Lock "cinder-quobyte-fd95fc22-674d-4035-bb57-de71b16e19d0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-615ebc38-bf35-46f2-9e42-bee3a41f87c7 tempest-SnapshotMetadataTestJSON-179050274 None] Acquiring lock "cinder-quobyte-4fe77fec-799f-4a4a-8421-2ad77960957b" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-615ebc38-bf35-46f2-9e42-bee3a41f87c7 tempest-SnapshotMetadataTestJSON-179050274 None] Lock "cinder-quobyte-4fe77fec-799f-4a4a-8421-2ad77960957b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-615ebc38-bf35-46f2-9e42-bee3a41f87c7 tempest-SnapshotMetadataTestJSON-179050274 None] Deleting offline snapshot 4fe77fec-799f-4a4a-8421-2ad77960957b of volume fd95fc22-674d-4035-bb57-de71b16e19d0 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:14:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-615ebc38-bf35-46f2-9e42-bee3a41f87c7 tempest-SnapshotMetadataTestJSON-179050274 None] snapshot_file for this snap is: volume-fd95fc22-674d-4035-bb57-de71b16e19d0.4fe77fec-799f-4a4a-8421-2ad77960957b {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:14:58 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8635662-10fe-4234-bb9d-7cba23f93447]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:14:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-615ebc38-bf35-46f2-9e42-bee3a41f87c7 tempest-SnapshotMetadataTestJSON-179050274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0.4fe77fec-799f-4a4a-8421-2ad77960957b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:58 devstack sudo[96228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0.4fe77fec-799f-4a4a-8421-2ad77960957b Jul 08 01:14:58 devstack sudo[96228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:58 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ad4e28d2-cc47-49c5-8a11-48564b78374e" returned: 0 in 0.682s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:14:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.928s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-604321148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd1a67b-9801-4479-ae75-c797040d9116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1ed405951ad446790116e7f1f9a1f7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:58Z,use_quota=True,user_id='864ead09be0346b6a47876bb5d9803d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:14:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Creating volume 3cd1a67b-9801-4479-ae75-c797040d9116 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:14:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:14:58 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:14:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3cd1a67b-9801-4479-ae75-c797040d9116 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:58 devstack sudo[96231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3cd1a67b-9801-4479-ae75-c797040d9116 1073741824 Jul 08 01:14:58 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ede62a-d714-4ede-8049-422a97d92f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad4e28d2-cc47-49c5-8a11-48564b78374e', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7901610-7069-43ab-8010-576e892f6976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:58 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Volume volume-ad4e28d2-cc47-49c5-8a11-48564b78374e (ad4e28d2-cc47-49c5-8a11-48564b78374e): created successfully Jul 08 01:14:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7901610-7069-43ab-8010-576e892f6976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Flow 'volume_create_manager' (e7944282-985c-4155-b389-f16a7d0f2b8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:58 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-76fa61fa-cf9e-4be8-a8e4-46361681ec0f tempest-VolumesActionsTest-1767978080 None] Created volume successfully. Jul 08 01:14:59 devstack sudo[96228]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-615ebc38-bf35-46f2-9e42-bee3a41f87c7 tempest-SnapshotMetadataTestJSON-179050274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0.4fe77fec-799f-4a4a-8421-2ad77960957b" returned: 0 in 0.778s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-615ebc38-bf35-46f2-9e42-bee3a41f87c7 tempest-SnapshotMetadataTestJSON-179050274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd95fc22-674d-4035-bb57-de71b16e19d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:14:59 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f6cf54-b508-4569-b457-a33633c2b79e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:14:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-615ebc38-bf35-46f2-9e42-bee3a41f87c7 tempest-SnapshotMetadataTestJSON-179050274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:59 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0 Jul 08 01:14:59 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:59 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3cd1a67b-9801-4479-ae75-c797040d9116 1073741824" returned: 0 in 0.842s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3cd1a67b-9801-4479-ae75-c797040d9116 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:59 devstack sudo[96242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3cd1a67b-9801-4479-ae75-c797040d9116 Jul 08 01:14:59 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:00 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-615ebc38-bf35-46f2-9e42-bee3a41f87c7 tempest-SnapshotMetadataTestJSON-179050274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0" returned: 0 in 0.817s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-615ebc38-bf35-46f2-9e42-bee3a41f87c7 tempest-SnapshotMetadataTestJSON-179050274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0.4fe77fec-799f-4a4a-8421-2ad77960957b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:00 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0.4fe77fec-799f-4a4a-8421-2ad77960957b Jul 08 01:15:00 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:00 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-05182b49-e378-42b8-ac32-258fce97d9a1 tempest-VolumesActionsTest-70982765 None] Acquiring lock "cinder-ad4e28d2-cc47-49c5-8a11-48564b78374e-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:00 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-05182b49-e378-42b8-ac32-258fce97d9a1 tempest-VolumesActionsTest-70982765 None] Lock "cinder-ad4e28d2-cc47-49c5-8a11-48564b78374e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:00 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-05182b49-e378-42b8-ac32-258fce97d9a1 tempest-VolumesActionsTest-70982765 None] Acquiring lock "cinder-quobyte-ad4e28d2-cc47-49c5-8a11-48564b78374e" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:00 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-05182b49-e378-42b8-ac32-258fce97d9a1 tempest-VolumesActionsTest-70982765 None] Lock "cinder-quobyte-ad4e28d2-cc47-49c5-8a11-48564b78374e" acquired by "delete_volume" :: waited 0.020s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:00 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9e24dc-2ce1-47a6-a531-feb0ef4b4a62]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-05182b49-e378-42b8-ac32-258fce97d9a1 tempest-VolumesActionsTest-70982765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ad4e28d2-cc47-49c5-8a11-48564b78374e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:00 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3cd1a67b-9801-4479-ae75-c797040d9116" returned: 0 in 0.674s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:00 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:15:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.404s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:00 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1012992157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8673479-9a05-4eee-b7bc-5e7fb266a843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8953228fcc4e16b525c02638da6b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:58Z,use_quota=True,user_id='0d1b372cd0da4116a60f3a2d1346e15f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c19afca2-7c00-4d45-b7a1-74b86da50955),volume_type_id=c19afca2-7c00-4d45-b7a1-74b86da50955)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:15:00 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Creating volume d8673479-9a05-4eee-b7bc-5e7fb266a843 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:15:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:00 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:00 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:00 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:15:00 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:15:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d8673479-9a05-4eee-b7bc-5e7fb266a843 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:00 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ad4e28d2-cc47-49c5-8a11-48564b78374e Jul 08 01:15:00 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:00 devstack sudo[96251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d8673479-9a05-4eee-b7bc-5e7fb266a843 1073741824 Jul 08 01:15:00 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d70dfd4-4309-4858-ad91-a51998957dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cd1a67b-9801-4479-ae75-c797040d9116', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6b898ca-ee67-4e6e-adeb-54ef62914ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:00 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Volume volume-3cd1a67b-9801-4479-ae75-c797040d9116 (3cd1a67b-9801-4479-ae75-c797040d9116): created successfully Jul 08 01:15:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6b898ca-ee67-4e6e-adeb-54ef62914ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Flow 'volume_create_manager' (ee7f85cb-8496-4eb1-b1a7-37f342105ea1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:00 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-446c8617-fda3-4745-97fe-5cc35ff0f5c8 tempest-VolumesListAdminTestJSON-490636651 None] Created volume successfully. Jul 08 01:15:00 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-615ebc38-bf35-46f2-9e42-bee3a41f87c7 tempest-SnapshotMetadataTestJSON-179050274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0.4fe77fec-799f-4a4a-8421-2ad77960957b" returned: 0 in 0.849s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-615ebc38-bf35-46f2-9e42-bee3a41f87c7 tempest-SnapshotMetadataTestJSON-179050274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0.4fe77fec-799f-4a4a-8421-2ad77960957b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:00 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0.4fe77fec-799f-4a4a-8421-2ad77960957b Jul 08 01:15:00 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:01 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-05182b49-e378-42b8-ac32-258fce97d9a1 tempest-VolumesActionsTest-70982765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ad4e28d2-cc47-49c5-8a11-48564b78374e" returned: 0 in 0.909s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-05182b49-e378-42b8-ac32-258fce97d9a1 tempest-VolumesActionsTest-70982765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ad4e28d2-cc47-49c5-8a11-48564b78374e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:01 devstack sudo[96266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ad4e28d2-cc47-49c5-8a11-48564b78374e Jul 08 01:15:01 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:01 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:15:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Flow 'volume_create_manager' (e8154e6b-dbb0-4d7c-b5b6-50a1273cfcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22ccdda-4660-4f8e-a87e-02560c58c0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:01 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d8673479-9a05-4eee-b7bc-5e7fb266a843 1073741824" returned: 0 in 1.036s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22ccdda-4660-4f8e-a87e-02560c58c0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-99017419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=546feb34-cf4a-44ec-9a81-38c0f18a9936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1ed405951ad446790116e7f1f9a1f7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:15:01Z,use_quota=True,user_id='864ead09be0346b6a47876bb5d9803d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2cf07f-3094-4912-875f-0e4b4af0d6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2cf07f-3094-4912-875f-0e4b4af0d6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8950edc2-dff6-46ca-a498-2a2342fa2c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8950edc2-dff6-46ca-a498-2a2342fa2c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '546feb34-cf4a-44ec-9a81-38c0f18a9936', 'volume_name': 'volume-546feb34-cf4a-44ec-9a81-38c0f18a9936', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3829039-4ca2-41a8-b92d-1f7e19ec4d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3829039-4ca2-41a8-b92d-1f7e19ec4d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d8369e-f062-465a-baad-310af3ca6613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:01 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Volume 546feb34-cf4a-44ec-9a81-38c0f18a9936: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-546feb34-cf4a-44ec-9a81-38c0f18a9936', 'volume_size': 1} Jul 08 01:15:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d8673479-9a05-4eee-b7bc-5e7fb266a843 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:01 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d8673479-9a05-4eee-b7bc-5e7fb266a843 Jul 08 01:15:01 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:01 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-615ebc38-bf35-46f2-9e42-bee3a41f87c7 tempest-SnapshotMetadataTestJSON-179050274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0.4fe77fec-799f-4a4a-8421-2ad77960957b" returned: 0 in 0.736s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:01 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-615ebc38-bf35-46f2-9e42-bee3a41f87c7 tempest-SnapshotMetadataTestJSON-179050274 None] Lock "cinder-quobyte-4fe77fec-799f-4a4a-8421-2ad77960957b" released by "_delete_snapshot" :: held 3.323s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:01 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-615ebc38-bf35-46f2-9e42-bee3a41f87c7 tempest-SnapshotMetadataTestJSON-179050274 None] Lock "cinder-quobyte-fd95fc22-674d-4035-bb57-de71b16e19d0" released by "delete_snapshot" :: held 3.350s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:01 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-615ebc38-bf35-46f2-9e42-bee3a41f87c7 tempest-SnapshotMetadataTestJSON-179050274 None] Created reservations ['4b7b3a82-5414-417d-bcaa-d494d90a8bb9', 'd8f85eac-5d09-41d7-b007-cd50d1e44dc7', '9d33b62d-56ec-4da1-b13b-f0b3d4fea2ec', 'cb93f3a2-931f-4b49-984a-fa86788d321b'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:15:01 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-615ebc38-bf35-46f2-9e42-bee3a41f87c7 tempest-SnapshotMetadataTestJSON-179050274 None] Delete snapshot completed successfully. Jul 08 01:15:01 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-615ebc38-bf35-46f2-9e42-bee3a41f87c7 tempest-SnapshotMetadataTestJSON-179050274 None] Lock "cinder-4fe77fec-799f-4a4a-8421-2ad77960957b-delete_snapshot" released by "delete_snapshot" :: held 3.496s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:01 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-05182b49-e378-42b8-ac32-258fce97d9a1 tempest-VolumesActionsTest-70982765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ad4e28d2-cc47-49c5-8a11-48564b78374e" returned: 0 in 0.751s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:01 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-05182b49-e378-42b8-ac32-258fce97d9a1 tempest-VolumesActionsTest-70982765 None] Lock "cinder-quobyte-ad4e28d2-cc47-49c5-8a11-48564b78374e" released by "delete_volume" :: held 1.706s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:01 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=119,cinder:UPDATE=136,cinder:DELETE=7,cinder:INSERT=34 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:15:01 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-05182b49-e378-42b8-ac32-258fce97d9a1 tempest-VolumesActionsTest-70982765 None] Created reservations ['7bf767df-628e-462e-9d59-6a03dcfcb7db', '3e5e6887-41e1-4264-b40f-ca687f4f9863', '4797b888-4110-4c1c-b672-3f4da65eab87', '10a68e27-68b4-4d02-a767-b2a9350ddd80'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-05182b49-e378-42b8-ac32-258fce97d9a1 tempest-VolumesActionsTest-70982765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-05182b49-e378-42b8-ac32-258fce97d9a1 tempest-VolumesActionsTest-70982765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-05182b49-e378-42b8-ac32-258fce97d9a1 tempest-VolumesActionsTest-70982765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-05182b49-e378-42b8-ac32-258fce97d9a1 tempest-VolumesActionsTest-70982765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-05182b49-e378-42b8-ac32-258fce97d9a1 tempest-VolumesActionsTest-70982765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-05182b49-e378-42b8-ac32-258fce97d9a1 tempest-VolumesActionsTest-70982765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:02 devstack sudo[96276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:15:02 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:02 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d8673479-9a05-4eee-b7bc-5e7fb266a843" returned: 0 in 0.718s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.752s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-99017419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=546feb34-cf4a-44ec-9a81-38c0f18a9936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1ed405951ad446790116e7f1f9a1f7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:15:01Z,use_quota=True,user_id='864ead09be0346b6a47876bb5d9803d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Creating volume 546feb34-cf4a-44ec-9a81-38c0f18a9936 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:15:02 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-546feb34-cf4a-44ec-9a81-38c0f18a9936 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84cb3995-b389-496e-9e05-a750e16a240d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8673479-9a05-4eee-b7bc-5e7fb266a843', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:02 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-546feb34-cf4a-44ec-9a81-38c0f18a9936 1073741824 Jul 08 01:15:02 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893e6462-da0b-4cce-af98-c267b55ae04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:02 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Volume volume-d8673479-9a05-4eee-b7bc-5e7fb266a843 (d8673479-9a05-4eee-b7bc-5e7fb266a843): created successfully Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893e6462-da0b-4cce-af98-c267b55ae04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Flow 'volume_create_manager' (886fe51f-97b4-4f02-a89f-49e3c529dcfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:02 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-89375065-fd3d-4e82-8ef2-9a93f55bedb0 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Created volume successfully. Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d15835b1-177b-4809-9af1-a97efa4a8525 tempest-SnapshotMetadataTestJSON-179050274 None] Acquiring lock "cinder-fd95fc22-674d-4035-bb57-de71b16e19d0-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d15835b1-177b-4809-9af1-a97efa4a8525 tempest-SnapshotMetadataTestJSON-179050274 None] Lock "cinder-fd95fc22-674d-4035-bb57-de71b16e19d0-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d15835b1-177b-4809-9af1-a97efa4a8525 tempest-SnapshotMetadataTestJSON-179050274 None] Acquiring lock "cinder-quobyte-fd95fc22-674d-4035-bb57-de71b16e19d0" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:02 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d15835b1-177b-4809-9af1-a97efa4a8525 tempest-SnapshotMetadataTestJSON-179050274 None] Lock "cinder-quobyte-fd95fc22-674d-4035-bb57-de71b16e19d0" acquired by "delete_volume" :: waited 0.024s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-05182b49-e378-42b8-ac32-258fce97d9a1 tempest-VolumesActionsTest-70982765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.898s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-05182b49-e378-42b8-ac32-258fce97d9a1 tempest-VolumesActionsTest-70982765 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:15:02 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-05182b49-e378-42b8-ac32-258fce97d9a1 tempest-VolumesActionsTest-70982765 None] Deleted volume successfully. Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-05182b49-e378-42b8-ac32-258fce97d9a1 tempest-VolumesActionsTest-70982765 None] Lock "cinder-ad4e28d2-cc47-49c5-8a11-48564b78374e-delete_volume" released by "delete_volume" :: held 2.826s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b55bdb-62a0-45c6-8a1f-b25edbb6d06c]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d15835b1-177b-4809-9af1-a97efa4a8525 tempest-SnapshotMetadataTestJSON-179050274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:03 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:15:03 devstack sudo[96286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0 Jul 08 01:15:03 devstack sudo[96286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Flow 'volume_create_manager' (d4a2d027-7f23-4240-aae1-ab773c7d9999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2c1ddcb-c0e2-494e-b34c-dc40e5a3013c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2c1ddcb-c0e2-494e-b34c-dc40e5a3013c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-223409390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c421cb-3e1d-44b2-9635-ee02a42f84d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda3b4f4678a41c5bc3b9910dab51def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:15:03Z,use_quota=True,user_id='6328190b6cc548b3a39d11e971e9ea1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d38878-90d7-42e2-a21d-16347a147c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d38878-90d7-42e2-a21d-16347a147c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b326f031-f7cc-4573-93fa-e27014e1beaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b326f031-f7cc-4573-93fa-e27014e1beaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8c421cb-3e1d-44b2-9635-ee02a42f84d0', 'volume_name': 'volume-d8c421cb-3e1d-44b2-9635-ee02a42f84d0', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba52173c-45e4-479e-8ab1-eccd4afbc452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba52173c-45e4-479e-8ab1-eccd4afbc452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b5f50c-663e-4c20-8cbf-e6f643f04df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:03 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Volume d8c421cb-3e1d-44b2-9635-ee02a42f84d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8c421cb-3e1d-44b2-9635-ee02a42f84d0', 'volume_size': 1} Jul 08 01:15:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:03 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-546feb34-cf4a-44ec-9a81-38c0f18a9936 1073741824" returned: 0 in 1.222s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-546feb34-cf4a-44ec-9a81-38c0f18a9936 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:03 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-546feb34-cf4a-44ec-9a81-38c0f18a9936 Jul 08 01:15:03 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d0ee1f4f-6276-4d06-b9db-b4767da5251c tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d0ee1f4f-6276-4d06-b9db-b4767da5251c tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:03 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d0ee1f4f-6276-4d06-b9db-b4767da5251c tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:03 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d0ee1f4f-6276-4d06-b9db-b4767da5251c tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d0ee1f4f-6276-4d06-b9db-b4767da5251c tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d0ee1f4f-6276-4d06-b9db-b4767da5251c tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:03 devstack sudo[96292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:15:03 devstack sudo[96292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:03 devstack sudo[96286]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d15835b1-177b-4809-9af1-a97efa4a8525 tempest-SnapshotMetadataTestJSON-179050274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0" returned: 0 in 0.913s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d15835b1-177b-4809-9af1-a97efa4a8525 tempest-SnapshotMetadataTestJSON-179050274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:03 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0 Jul 08 01:15:03 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:04 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-546feb34-cf4a-44ec-9a81-38c0f18a9936" returned: 0 in 0.737s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] <== create_volume: return (2016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.020s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.969s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-223409390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c421cb-3e1d-44b2-9635-ee02a42f84d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda3b4f4678a41c5bc3b9910dab51def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:15:03Z,use_quota=True,user_id='6328190b6cc548b3a39d11e971e9ea1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Creating volume d8c421cb-3e1d-44b2-9635-ee02a42f84d0 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:15:04 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d8c421cb-3e1d-44b2-9635-ee02a42f84d0 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d8369e-f062-465a-baad-310af3ca6613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-546feb34-cf4a-44ec-9a81-38c0f18a9936', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:04 devstack sudo[96301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d8c421cb-3e1d-44b2-9635-ee02a42f84d0 1073741824 Jul 08 01:15:04 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1169797d-d660-48ad-bcca-ba68151148f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:04 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Volume volume-546feb34-cf4a-44ec-9a81-38c0f18a9936 (546feb34-cf4a-44ec-9a81-38c0f18a9936): created successfully Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1169797d-d660-48ad-bcca-ba68151148f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Flow 'volume_create_manager' (e8154e6b-dbb0-4d7c-b5b6-50a1273cfcbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:04 devstack sudo[96292]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d0ee1f4f-6276-4d06-b9db-b4767da5251c tempest-VolumeRetypeWithoutMigrationTest-493978990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.787s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-d0ee1f4f-6276-4d06-b9db-b4767da5251c tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:15:04 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-d0ee1f4f-6276-4d06-b9db-b4767da5251c tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Retype volume completed successfully. Jul 08 01:15:04 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-1e7ac737-80e1-405b-b2aa-930971fc859e tempest-VolumesListAdminTestJSON-490636651 None] Created volume successfully. Jul 08 01:15:04 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d15835b1-177b-4809-9af1-a97efa4a8525 tempest-SnapshotMetadataTestJSON-179050274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd95fc22-674d-4035-bb57-de71b16e19d0" returned: 0 in 0.777s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d15835b1-177b-4809-9af1-a97efa4a8525 tempest-SnapshotMetadataTestJSON-179050274 None] Lock "cinder-quobyte-fd95fc22-674d-4035-bb57-de71b16e19d0" released by "delete_volume" :: held 1.827s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4658065b-3375-4c06-8f98-59c350b36963 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Acquiring lock "cinder-d8673479-9a05-4eee-b7bc-5e7fb266a843-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-d15835b1-177b-4809-9af1-a97efa4a8525 tempest-SnapshotMetadataTestJSON-179050274 None] Created reservations ['de1c2217-4d84-43e9-8283-7ab2990acde1', 'b8ade977-60f3-4893-b88a-ca01a5aa0589', 'b2f9bc09-46c7-4ba9-9619-994fc7931dbd', 'b6882e01-e3fb-4dab-ad12-b72567310f0d'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4658065b-3375-4c06-8f98-59c350b36963 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Lock "cinder-d8673479-9a05-4eee-b7bc-5e7fb266a843-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4658065b-3375-4c06-8f98-59c350b36963 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Acquiring lock "cinder-quobyte-d8673479-9a05-4eee-b7bc-5e7fb266a843" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4658065b-3375-4c06-8f98-59c350b36963 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Lock "cinder-quobyte-d8673479-9a05-4eee-b7bc-5e7fb266a843" acquired by "delete_volume" :: waited 0.029s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[47dfe831-4399-4345-98dd-dc41da542fb1]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4658065b-3375-4c06-8f98-59c350b36963 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d8673479-9a05-4eee-b7bc-5e7fb266a843 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d15835b1-177b-4809-9af1-a97efa4a8525 tempest-SnapshotMetadataTestJSON-179050274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d15835b1-177b-4809-9af1-a97efa4a8525 tempest-SnapshotMetadataTestJSON-179050274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d15835b1-177b-4809-9af1-a97efa4a8525 tempest-SnapshotMetadataTestJSON-179050274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d15835b1-177b-4809-9af1-a97efa4a8525 tempest-SnapshotMetadataTestJSON-179050274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d15835b1-177b-4809-9af1-a97efa4a8525 tempest-SnapshotMetadataTestJSON-179050274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d15835b1-177b-4809-9af1-a97efa4a8525 tempest-SnapshotMetadataTestJSON-179050274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:05 devstack sudo[96308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:15:05 devstack sudo[96308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:05 devstack sudo[96306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d8673479-9a05-4eee-b7bc-5e7fb266a843 Jul 08 01:15:05 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:05 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:15:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Flow 'volume_create_manager' (49af4b9b-5c59-4e8c-9f4e-96d34076dccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dfe11c9-1f21-44eb-ad6d-5ea4f161776c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dfe11c9-1f21-44eb-ad6d-5ea4f161776c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1638449064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7f4727e-dd13-449c-b18f-16817da36ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1ed405951ad446790116e7f1f9a1f7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:15:05Z,use_quota=True,user_id='864ead09be0346b6a47876bb5d9803d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d0ee5a-66d0-435e-978e-d5501360e16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d0ee5a-66d0-435e-978e-d5501360e16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f54a83-d2c3-4c8b-ac06-85e38e76d19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f54a83-d2c3-4c8b-ac06-85e38e76d19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7f4727e-dd13-449c-b18f-16817da36ec0', 'volume_name': 'volume-b7f4727e-dd13-449c-b18f-16817da36ec0', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7bc6ad5-0246-4cac-bd7a-97a76b205c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7bc6ad5-0246-4cac-bd7a-97a76b205c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590c1cd8-4fd8-49f1-8d4e-c949c6e45d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:05 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Volume b7f4727e-dd13-449c-b18f-16817da36ec0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7f4727e-dd13-449c-b18f-16817da36ec0', 'volume_size': 1} Jul 08 01:15:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:05 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d8c421cb-3e1d-44b2-9635-ee02a42f84d0 1073741824" returned: 0 in 1.237s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d8c421cb-3e1d-44b2-9635-ee02a42f84d0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:05 devstack sudo[96312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d8c421cb-3e1d-44b2-9635-ee02a42f84d0 Jul 08 01:15:05 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:05 devstack sudo[96308]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d15835b1-177b-4809-9af1-a97efa4a8525 tempest-SnapshotMetadataTestJSON-179050274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.862s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:05 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-d15835b1-177b-4809-9af1-a97efa4a8525 tempest-SnapshotMetadataTestJSON-179050274 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:15:05 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-d15835b1-177b-4809-9af1-a97efa4a8525 tempest-SnapshotMetadataTestJSON-179050274 None] Deleted volume successfully. Jul 08 01:15:05 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d15835b1-177b-4809-9af1-a97efa4a8525 tempest-SnapshotMetadataTestJSON-179050274 None] Lock "cinder-fd95fc22-674d-4035-bb57-de71b16e19d0-delete_volume" released by "delete_volume" :: held 3.126s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:06 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4658065b-3375-4c06-8f98-59c350b36963 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d8673479-9a05-4eee-b7bc-5e7fb266a843" returned: 0 in 1.059s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4658065b-3375-4c06-8f98-59c350b36963 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d8673479-9a05-4eee-b7bc-5e7fb266a843 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:06 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d8673479-9a05-4eee-b7bc-5e7fb266a843 Jul 08 01:15:06 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:06 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d8c421cb-3e1d-44b2-9635-ee02a42f84d0" returned: 0 in 0.832s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:06 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] <== create_volume: return (2149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:15:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.153s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:06 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1638449064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7f4727e-dd13-449c-b18f-16817da36ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1ed405951ad446790116e7f1f9a1f7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:15:05Z,use_quota=True,user_id='864ead09be0346b6a47876bb5d9803d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:15:06 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Creating volume b7f4727e-dd13-449c-b18f-16817da36ec0 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:15:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:06 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:06 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:06 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:15:06 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:15:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b7f4727e-dd13-449c-b18f-16817da36ec0 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b5f50c-663e-4c20-8cbf-e6f643f04df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8c421cb-3e1d-44b2-9635-ee02a42f84d0', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce08345-4b5b-404d-b2a7-63a92da37a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:06 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b7f4727e-dd13-449c-b18f-16817da36ec0 1073741824 Jul 08 01:15:06 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:06 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Volume volume-d8c421cb-3e1d-44b2-9635-ee02a42f84d0 (d8c421cb-3e1d-44b2-9635-ee02a42f84d0): created successfully Jul 08 01:15:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce08345-4b5b-404d-b2a7-63a92da37a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Flow 'volume_create_manager' (d4a2d027-7f23-4240-aae1-ab773c7d9999) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:06 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-716b8c15-3908-4d02-838e-19efd2e1cee5 tempest-VolumesActionsTest-1767978080 None] Created volume successfully. Jul 08 01:15:06 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4658065b-3375-4c06-8f98-59c350b36963 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d8673479-9a05-4eee-b7bc-5e7fb266a843" returned: 0 in 0.932s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:06 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4658065b-3375-4c06-8f98-59c350b36963 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Lock "cinder-quobyte-d8673479-9a05-4eee-b7bc-5e7fb266a843" released by "delete_volume" :: held 2.063s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:07 devstack cinder-volume[87022]: WARNING cinder.quota [None req-4658065b-3375-4c06-8f98-59c350b36963 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:15:07 devstack cinder-volume[87022]: WARNING cinder.quota [None req-4658065b-3375-4c06-8f98-59c350b36963 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:15:07 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-4658065b-3375-4c06-8f98-59c350b36963 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Created reservations ['36c9d28f-f966-4f57-8f93-b799f03bcc8a', 'c3b78af1-a6c6-4160-8dfd-bc8d08baec92', '98a7d232-dcef-4c31-baa3-e90a97481d70', '4383951e-a60c-41ed-add3-5e15867b05b2'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:15:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4658065b-3375-4c06-8f98-59c350b36963 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4658065b-3375-4c06-8f98-59c350b36963 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:07 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4658065b-3375-4c06-8f98-59c350b36963 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:07 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4658065b-3375-4c06-8f98-59c350b36963 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4658065b-3375-4c06-8f98-59c350b36963 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4658065b-3375-4c06-8f98-59c350b36963 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:07 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:15:07 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:07 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b7f4727e-dd13-449c-b18f-16817da36ec0 1073741824" returned: 0 in 1.089s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b7f4727e-dd13-449c-b18f-16817da36ec0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:07 devstack sudo[96368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b7f4727e-dd13-449c-b18f-16817da36ec0 Jul 08 01:15:07 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:07 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5bd7481d-3ccc-4ebe-85c0-37e670bfec19 tempest-VolumesActionsTest-70982765 None] Acquiring lock "cinder-d8c421cb-3e1d-44b2-9635-ee02a42f84d0-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:07 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5bd7481d-3ccc-4ebe-85c0-37e670bfec19 tempest-VolumesActionsTest-70982765 None] Lock "cinder-d8c421cb-3e1d-44b2-9635-ee02a42f84d0-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:07 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5bd7481d-3ccc-4ebe-85c0-37e670bfec19 tempest-VolumesActionsTest-70982765 None] Acquiring lock "cinder-quobyte-d8c421cb-3e1d-44b2-9635-ee02a42f84d0" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:07 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5bd7481d-3ccc-4ebe-85c0-37e670bfec19 tempest-VolumesActionsTest-70982765 None] Lock "cinder-quobyte-d8c421cb-3e1d-44b2-9635-ee02a42f84d0" acquired by "delete_volume" :: waited 0.026s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:07 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[962376e7-66f6-440f-9e99-9efc7c8b3f43]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5bd7481d-3ccc-4ebe-85c0-37e670bfec19 tempest-VolumesActionsTest-70982765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d8c421cb-3e1d-44b2-9635-ee02a42f84d0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:07 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4658065b-3375-4c06-8f98-59c350b36963 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.792s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:07 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-4658065b-3375-4c06-8f98-59c350b36963 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:15:07 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-4658065b-3375-4c06-8f98-59c350b36963 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Deleted volume successfully. Jul 08 01:15:07 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d8c421cb-3e1d-44b2-9635-ee02a42f84d0 Jul 08 01:15:07 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:07 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4658065b-3375-4c06-8f98-59c350b36963 tempest-VolumeRetypeWithoutMigrationTest-493978990 None] Lock "cinder-d8673479-9a05-4eee-b7bc-5e7fb266a843-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:08 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b7f4727e-dd13-449c-b18f-16817da36ec0" returned: 0 in 0.848s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:08 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] <== create_volume: return (2008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:15:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590c1cd8-4fd8-49f1-8d4e-c949c6e45d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7f4727e-dd13-449c-b18f-16817da36ec0', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f281a466-3a3d-4d25-a9dd-9d5158d72ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:08 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Volume volume-b7f4727e-dd13-449c-b18f-16817da36ec0 (b7f4727e-dd13-449c-b18f-16817da36ec0): created successfully Jul 08 01:15:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f281a466-3a3d-4d25-a9dd-9d5158d72ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Flow 'volume_create_manager' (49af4b9b-5c59-4e8c-9f4e-96d34076dccb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:08 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-933ca4c2-3f11-433d-a67d-b43d36fd103e tempest-VolumesListAdminTestJSON-490636651 None] Created volume successfully. Jul 08 01:15:08 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5bd7481d-3ccc-4ebe-85c0-37e670bfec19 tempest-VolumesActionsTest-70982765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d8c421cb-3e1d-44b2-9635-ee02a42f84d0" returned: 0 in 1.030s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5bd7481d-3ccc-4ebe-85c0-37e670bfec19 tempest-VolumesActionsTest-70982765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d8c421cb-3e1d-44b2-9635-ee02a42f84d0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:08 devstack sudo[96379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d8c421cb-3e1d-44b2-9635-ee02a42f84d0 Jul 08 01:15:08 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:09 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5bd7481d-3ccc-4ebe-85c0-37e670bfec19 tempest-VolumesActionsTest-70982765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d8c421cb-3e1d-44b2-9635-ee02a42f84d0" returned: 0 in 0.831s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:09 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5bd7481d-3ccc-4ebe-85c0-37e670bfec19 tempest-VolumesActionsTest-70982765 None] Lock "cinder-quobyte-d8c421cb-3e1d-44b2-9635-ee02a42f84d0" released by "delete_volume" :: held 1.929s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:09 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-5bd7481d-3ccc-4ebe-85c0-37e670bfec19 tempest-VolumesActionsTest-70982765 None] Created reservations ['27d0889a-1ef3-4867-bad4-c42126a18043', '4ff3d615-b3a3-4283-b5ca-b5a4550f2850', 'b6ea7d50-9f53-4d98-a3ce-c40df544dafc', '8e46727f-6c87-4f9a-8469-8aa81b140798'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:15:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5bd7481d-3ccc-4ebe-85c0-37e670bfec19 tempest-VolumesActionsTest-70982765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5bd7481d-3ccc-4ebe-85c0-37e670bfec19 tempest-VolumesActionsTest-70982765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5bd7481d-3ccc-4ebe-85c0-37e670bfec19 tempest-VolumesActionsTest-70982765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5bd7481d-3ccc-4ebe-85c0-37e670bfec19 tempest-VolumesActionsTest-70982765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5bd7481d-3ccc-4ebe-85c0-37e670bfec19 tempest-VolumesActionsTest-70982765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5bd7481d-3ccc-4ebe-85c0-37e670bfec19 tempest-VolumesActionsTest-70982765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:09 devstack sudo[96382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:15:09 devstack sudo[96382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:10 devstack sudo[96382]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5bd7481d-3ccc-4ebe-85c0-37e670bfec19 tempest-VolumesActionsTest-70982765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.974s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:10 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-5bd7481d-3ccc-4ebe-85c0-37e670bfec19 tempest-VolumesActionsTest-70982765 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:15:10 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-5bd7481d-3ccc-4ebe-85c0-37e670bfec19 tempest-VolumesActionsTest-70982765 None] Deleted volume successfully. Jul 08 01:15:10 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5bd7481d-3ccc-4ebe-85c0-37e670bfec19 tempest-VolumesActionsTest-70982765 None] Lock "cinder-d8c421cb-3e1d-44b2-9635-ee02a42f84d0-delete_volume" released by "delete_volume" :: held 3.188s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Flow 'volume_create_manager' (c7092607-e409-44b4-88e7-90fa72444f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f711612-1e02-47ce-a105-cecb419e842d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f711612-1e02-47ce-a105-cecb419e842d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1033785903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55bdd079-a03e-4453-8ea2-7339c2614e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda3b4f4678a41c5bc3b9910dab51def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:15:11Z,use_quota=True,user_id='6328190b6cc548b3a39d11e971e9ea1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e368d5a8-2630-4e34-9fde-906cdd433b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e368d5a8-2630-4e34-9fde-906cdd433b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bb25070-ee21-49cf-8cc1-8318b036df62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bb25070-ee21-49cf-8cc1-8318b036df62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55bdd079-a03e-4453-8ea2-7339c2614e34', 'volume_name': 'volume-55bdd079-a03e-4453-8ea2-7339c2614e34', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4677c65e-64c4-4a5a-b553-37701d005e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4677c65e-64c4-4a5a-b553-37701d005e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e0cd1f-663c-4bf0-a2e9-e4f77532ffcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:11 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Volume 55bdd079-a03e-4453-8ea2-7339c2614e34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55bdd079-a03e-4453-8ea2-7339c2614e34', 'volume_size': 1} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1033785903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55bdd079-a03e-4453-8ea2-7339c2614e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda3b4f4678a41c5bc3b9910dab51def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:15:11Z,use_quota=True,user_id='6328190b6cc548b3a39d11e971e9ea1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Creating volume 55bdd079-a03e-4453-8ea2-7339c2614e34 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:15:11 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-55bdd079-a03e-4453-8ea2-7339c2614e34 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:11 devstack sudo[96387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-55bdd079-a03e-4453-8ea2-7339c2614e34 1073741824 Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:15:11 devstack sudo[96387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Flow 'volume_create_manager' (2d151d3b-ff89-460d-8217-99e711fdb7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b4e750f-b39d-4721-be6b-3f6542a1ae48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b4e750f-b39d-4721-be6b-3f6542a1ae48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0c82f6d-561e-4db5-b2da-aeaf9b321168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98826a975fce4f3f8d199eca79f96581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:15:11Z,use_quota=True,user_id='bf4ab874dba6497ca93c89d1bd8e7636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b875644b-2911-4e9d-af5d-5d3183cfcd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b875644b-2911-4e9d-af5d-5d3183cfcd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b04c8c-06aa-48b5-ad0b-3331da563aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b04c8c-06aa-48b5-ad0b-3331da563aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0c82f6d-561e-4db5-b2da-aeaf9b321168', 'volume_name': 'volume-b0c82f6d-561e-4db5-b2da-aeaf9b321168', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d277485b-f960-41ca-90c1-1a9ec5b21502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d277485b-f960-41ca-90c1-1a9ec5b21502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a817c6ee-4794-40f1-b24e-da3c24d84fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:11 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Volume b0c82f6d-561e-4db5-b2da-aeaf9b321168: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0c82f6d-561e-4db5-b2da-aeaf9b321168', 'volume_size': 1} Jul 08 01:15:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:12 devstack sudo[96387]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-55bdd079-a03e-4453-8ea2-7339c2614e34 1073741824" returned: 0 in 1.114s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-55bdd079-a03e-4453-8ea2-7339c2614e34 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:12 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-55bdd079-a03e-4453-8ea2-7339c2614e34 Jul 08 01:15:12 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:13 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-55bdd079-a03e-4453-8ea2-7339c2614e34" returned: 0 in 0.757s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] <== create_volume: return (1921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:15:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.925s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.755s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0c82f6d-561e-4db5-b2da-aeaf9b321168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98826a975fce4f3f8d199eca79f96581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:15:11Z,use_quota=True,user_id='bf4ab874dba6497ca93c89d1bd8e7636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:15:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Creating volume b0c82f6d-561e-4db5-b2da-aeaf9b321168 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:15:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:15:13 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:15:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b0c82f6d-561e-4db5-b2da-aeaf9b321168 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:13 devstack sudo[96396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b0c82f6d-561e-4db5-b2da-aeaf9b321168 1073741824 Jul 08 01:15:13 devstack sudo[96396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e0cd1f-663c-4bf0-a2e9-e4f77532ffcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55bdd079-a03e-4453-8ea2-7339c2614e34', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02831e4-5a9f-4e65-984b-c0b2624c114f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:13 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Volume volume-55bdd079-a03e-4453-8ea2-7339c2614e34 (55bdd079-a03e-4453-8ea2-7339c2614e34): created successfully Jul 08 01:15:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02831e4-5a9f-4e65-984b-c0b2624c114f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Flow 'volume_create_manager' (c7092607-e409-44b4-88e7-90fa72444f83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:13 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-28735d1d-6fe4-446d-ac20-044113e2afb7 tempest-VolumesActionsTest-1767978080 None] Created volume successfully. Jul 08 01:15:13 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:15:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Flow 'volume_create_manager' (17bab40a-5ef8-4fdc-84da-facc3bf14499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ef23b40-bd95-4bd2-ab9d-f5b301a41884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ef23b40-bd95-4bd2-ab9d-f5b301a41884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1050199633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56bd1e78-7006-4ae6-bab0-76469c03a5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74f3324813284511906091e2ac65bcca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:15:13Z,use_quota=True,user_id='8d15e43c7809417ebcb0f5f68c29ce87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55bfa71c-33da-4b21-acf4-b6f9f1f58dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55bfa71c-33da-4b21-acf4-b6f9f1f58dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3562216d-c1bf-4c26-b55b-433c4c5d5455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:13 devstack cinder-volume[87022]: DEBUG cinder.image.glance [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Creating Keystone auth plugin from conf {{(pid=87022) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:15:14 devstack sudo[96396]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b0c82f6d-561e-4db5-b2da-aeaf9b321168 1073741824" returned: 0 in 1.070s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b0c82f6d-561e-4db5-b2da-aeaf9b321168 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:14 devstack sudo[96408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b0c82f6d-561e-4db5-b2da-aeaf9b321168 Jul 08 01:15:14 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3562216d-c1bf-4c26-b55b-433c4c5d5455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '56bd1e78-7006-4ae6-bab0-76469c03a5e9', 'volume_name': 'volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9', 'volume_size': 1, 'image_id': 'f4d67a52-db18-4750-abc4-5b7335c6e867', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4d67a52-db18-4750-abc4-5b7335c6e867', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81fea2dfa47f49cba26ad62301512b69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4d67a52-db18-4750-abc4-5b7335c6e867', 'created_at': datetime.datetime(2026, 7, 7, 22, 58, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 22, 58, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4d67a52-db18-4750-abc4-5b7335c6e867/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14136e20-6ec1-401c-9702-638129722821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14136e20-6ec1-401c-9702-638129722821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0e36aff-b6a6-4294-8c69-050b58cb8402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:14 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Volume 56bd1e78-7006-4ae6-bab0-76469c03a5e9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9', 'volume_size': 1, 'image_id': 'f4d67a52-db18-4750-abc4-5b7335c6e867', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4d67a52-db18-4750-abc4-5b7335c6e867', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81fea2dfa47f49cba26ad62301512b69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4d67a52-db18-4750-abc4-5b7335c6e867', 'created_at': datetime.datetime(2026, 7, 7, 22, 58, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 22, 58, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4d67a52-db18-4750-abc4-5b7335c6e867/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 01:15:14 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Trying to clone 56bd1e78-7006-4ae6-bab0-76469c03a5e9 from image f4d67a52-db18-4750-abc4-5b7335c6e867 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f4d67a52-db18-4750-abc4-5b7335c6e867', 'metadata': {}}]). {{(pid=87022) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:15:14 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5979fa21-755c-4875-bf81-c1392298025f tempest-VolumesActionsTest-1767978080 None] Acquiring lock "cinder-55bdd079-a03e-4453-8ea2-7339c2614e34-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:14 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5979fa21-755c-4875-bf81-c1392298025f tempest-VolumesActionsTest-1767978080 None] Lock "cinder-55bdd079-a03e-4453-8ea2-7339c2614e34-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:14 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_6_203suwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87022) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:15:14 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Image download 20.69 MB at 20.69 MB/s Jul 08 01:15:14 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5979fa21-755c-4875-bf81-c1392298025f tempest-VolumesActionsTest-1767978080 None] Acquiring lock "cinder-quobyte-55bdd079-a03e-4453-8ea2-7339c2614e34" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:15 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd813a77-92b2-4e2c-a68e-90b7b1302ffc]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_6_203suwdevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5979fa21-755c-4875-bf81-c1392298025f tempest-VolumesActionsTest-1767978080 None] Lock "cinder-quobyte-55bdd079-a03e-4453-8ea2-7339c2614e34" acquired by "delete_volume" :: waited 0.045s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:15 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ac104c-9cf5-4971-9a7f-ea2b19aef648]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5979fa21-755c-4875-bf81-c1392298025f tempest-VolumesActionsTest-1767978080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-55bdd079-a03e-4453-8ea2-7339c2614e34 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:15 devstack sudo[96431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_6_203suwdevstack@QuobyteHD Jul 08 01:15:15 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:15 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-55bdd079-a03e-4453-8ea2-7339c2614e34 Jul 08 01:15:15 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:15 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b0c82f6d-561e-4db5-b2da-aeaf9b321168" returned: 0 in 0.897s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:15 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] <== create_volume: return (2033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:15:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.039s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a817c6ee-4794-40f1-b24e-da3c24d84fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0c82f6d-561e-4db5-b2da-aeaf9b321168', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf37bb85-5028-40e8-982d-e0799c8bcbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:15 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Volume volume-b0c82f6d-561e-4db5-b2da-aeaf9b321168 (b0c82f6d-561e-4db5-b2da-aeaf9b321168): created successfully Jul 08 01:15:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf37bb85-5028-40e8-982d-e0799c8bcbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Flow 'volume_create_manager' (2d151d3b-ff89-460d-8217-99e711fdb7c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:15 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-7553ba1c-1c07-412c-b388-07ec468f6ddc tempest-VolumesListAdminTestJSON-784171213 None] Created volume successfully. Jul 08 01:15:15 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_6_203suwdevstack@QuobyteHD" returned: 0 in 0.862s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:15 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Temporary image f4d67a52-db18-4750-abc4-5b7335c6e867 is fetched for user 8d15e43c7809417ebcb0f5f68c29ce87. {{(pid=87022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:15:15 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5979fa21-755c-4875-bf81-c1392298025f tempest-VolumesActionsTest-1767978080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-55bdd079-a03e-4453-8ea2-7339c2614e34" returned: 0 in 0.874s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5979fa21-755c-4875-bf81-c1392298025f tempest-VolumesActionsTest-1767978080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-55bdd079-a03e-4453-8ea2-7339c2614e34 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:15 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-55bdd079-a03e-4453-8ea2-7339c2614e34 Jul 08 01:15:15 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:15 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[0375c988-24e7-427a-98c2-6595a58ebae0]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_6_203suwdevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:16 devstack sudo[96444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_6_203suwdevstack@QuobyteHD Jul 08 01:15:16 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bb0c307b-5034-47b0-8eb0-587b270e2507 tempest-VolumesListAdminTestJSON-784171213 None] Acquiring lock "cinder-b0c82f6d-561e-4db5-b2da-aeaf9b321168-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bb0c307b-5034-47b0-8eb0-587b270e2507 tempest-VolumesListAdminTestJSON-784171213 None] Lock "cinder-b0c82f6d-561e-4db5-b2da-aeaf9b321168-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bb0c307b-5034-47b0-8eb0-587b270e2507 tempest-VolumesListAdminTestJSON-784171213 None] Acquiring lock "cinder-quobyte-b0c82f6d-561e-4db5-b2da-aeaf9b321168" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bb0c307b-5034-47b0-8eb0-587b270e2507 tempest-VolumesListAdminTestJSON-784171213 None] Lock "cinder-quobyte-b0c82f6d-561e-4db5-b2da-aeaf9b321168" acquired by "delete_volume" :: waited 0.022s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:16 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dab4f1-1b15-467e-9bb3-d2dce1db8bb2]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bb0c307b-5034-47b0-8eb0-587b270e2507 tempest-VolumesListAdminTestJSON-784171213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b0c82f6d-561e-4db5-b2da-aeaf9b321168 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5dce7c79-a3a3-4a49-9d76-fe499b4f0c88 tempest-VolumesListAdminTestJSON-490636651 None] Acquiring lock "cinder-b7f4727e-dd13-449c-b18f-16817da36ec0-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5dce7c79-a3a3-4a49-9d76-fe499b4f0c88 tempest-VolumesListAdminTestJSON-490636651 None] Lock "cinder-b7f4727e-dd13-449c-b18f-16817da36ec0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:16 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5979fa21-755c-4875-bf81-c1392298025f tempest-VolumesActionsTest-1767978080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-55bdd079-a03e-4453-8ea2-7339c2614e34" returned: 0 in 0.880s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5979fa21-755c-4875-bf81-c1392298025f tempest-VolumesActionsTest-1767978080 None] Lock "cinder-quobyte-55bdd079-a03e-4453-8ea2-7339c2614e34" released by "delete_volume" :: held 1.822s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5dce7c79-a3a3-4a49-9d76-fe499b4f0c88 tempest-VolumesListAdminTestJSON-490636651 None] Acquiring lock "cinder-quobyte-b7f4727e-dd13-449c-b18f-16817da36ec0" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:16 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b0c82f6d-561e-4db5-b2da-aeaf9b321168 Jul 08 01:15:16 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5dce7c79-a3a3-4a49-9d76-fe499b4f0c88 tempest-VolumesListAdminTestJSON-490636651 None] Lock "cinder-quobyte-b7f4727e-dd13-449c-b18f-16817da36ec0" acquired by "delete_volume" :: waited 0.027s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:16 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a8bd15-b0e3-4baa-a5c1-273d306c45d7]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5dce7c79-a3a3-4a49-9d76-fe499b4f0c88 tempest-VolumesListAdminTestJSON-490636651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b7f4727e-dd13-449c-b18f-16817da36ec0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:16 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-5979fa21-755c-4875-bf81-c1392298025f tempest-VolumesActionsTest-1767978080 None] Created reservations ['5afb4601-1a00-4987-bae6-436787b571e9', '3238953c-125e-4dab-af2e-3937da55e8f8', 'd794c7f4-3414-4762-b499-67e2e062856d', '3a9f397b-cf5c-4005-9a11-dcf5f62df348'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:15:17 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_6_203suwdevstack@QuobyteHD" returned: 0 in 1.083s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1050199633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56bd1e78-7006-4ae6-bab0-76469c03a5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74f3324813284511906091e2ac65bcca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:15:13Z,use_quota=True,user_id='8d15e43c7809417ebcb0f5f68c29ce87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:15:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Creating volume 56bd1e78-7006-4ae6-bab0-76469c03a5e9 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:15:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:15:17 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:15:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:17 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b7f4727e-dd13-449c-b18f-16817da36ec0 Jul 08 01:15:17 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5979fa21-755c-4875-bf81-c1392298025f tempest-VolumesActionsTest-1767978080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5979fa21-755c-4875-bf81-c1392298025f tempest-VolumesActionsTest-1767978080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5979fa21-755c-4875-bf81-c1392298025f tempest-VolumesActionsTest-1767978080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5979fa21-755c-4875-bf81-c1392298025f tempest-VolumesActionsTest-1767978080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5979fa21-755c-4875-bf81-c1392298025f tempest-VolumesActionsTest-1767978080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5979fa21-755c-4875-bf81-c1392298025f tempest-VolumesActionsTest-1767978080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:17 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9 1073741824 Jul 08 01:15:17 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:17 devstack sudo[96456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:15:17 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:18 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5979fa21-755c-4875-bf81-c1392298025f tempest-VolumesActionsTest-1767978080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.988s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:18 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-5979fa21-755c-4875-bf81-c1392298025f tempest-VolumesActionsTest-1767978080 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:15:18 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-5979fa21-755c-4875-bf81-c1392298025f tempest-VolumesActionsTest-1767978080 None] Deleted volume successfully. Jul 08 01:15:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5979fa21-755c-4875-bf81-c1392298025f tempest-VolumesActionsTest-1767978080 None] Lock "cinder-55bdd079-a03e-4453-8ea2-7339c2614e34-delete_volume" released by "delete_volume" :: held 3.266s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:18 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5dce7c79-a3a3-4a49-9d76-fe499b4f0c88 tempest-VolumesListAdminTestJSON-490636651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b7f4727e-dd13-449c-b18f-16817da36ec0" returned: 0 in 1.347s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5dce7c79-a3a3-4a49-9d76-fe499b4f0c88 tempest-VolumesListAdminTestJSON-490636651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b7f4727e-dd13-449c-b18f-16817da36ec0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:18 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bb0c307b-5034-47b0-8eb0-587b270e2507 tempest-VolumesListAdminTestJSON-784171213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b0c82f6d-561e-4db5-b2da-aeaf9b321168" returned: 0 in 1.611s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bb0c307b-5034-47b0-8eb0-587b270e2507 tempest-VolumesListAdminTestJSON-784171213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b0c82f6d-561e-4db5-b2da-aeaf9b321168 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:18 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b7f4727e-dd13-449c-b18f-16817da36ec0 Jul 08 01:15:18 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:18 devstack sudo[96471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b0c82f6d-561e-4db5-b2da-aeaf9b321168 Jul 08 01:15:18 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:18 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9 1073741824" returned: 0 in 1.551s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:18 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9 Jul 08 01:15:18 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:19 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bb0c307b-5034-47b0-8eb0-587b270e2507 tempest-VolumesListAdminTestJSON-784171213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b0c82f6d-561e-4db5-b2da-aeaf9b321168" returned: 0 in 0.988s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bb0c307b-5034-47b0-8eb0-587b270e2507 tempest-VolumesListAdminTestJSON-784171213 None] Lock "cinder-quobyte-b0c82f6d-561e-4db5-b2da-aeaf9b321168" released by "delete_volume" :: held 2.667s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:19 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5dce7c79-a3a3-4a49-9d76-fe499b4f0c88 tempest-VolumesListAdminTestJSON-490636651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b7f4727e-dd13-449c-b18f-16817da36ec0" returned: 0 in 1.103s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:19 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-bb0c307b-5034-47b0-8eb0-587b270e2507 tempest-VolumesListAdminTestJSON-784171213 None] Created reservations ['f1d14ac0-6bfd-42ad-bf34-94500b326e2c', 'c815af1d-3be3-44aa-b928-2c3222fdf5de', 'a520ad42-9787-4e8c-9929-511c55c79342', '7b44dd15-1b53-4276-b507-cb39041c9ca5'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:15:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5dce7c79-a3a3-4a49-9d76-fe499b4f0c88 tempest-VolumesListAdminTestJSON-490636651 None] Lock "cinder-quobyte-b7f4727e-dd13-449c-b18f-16817da36ec0" released by "delete_volume" :: held 2.514s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bb0c307b-5034-47b0-8eb0-587b270e2507 tempest-VolumesListAdminTestJSON-784171213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bb0c307b-5034-47b0-8eb0-587b270e2507 tempest-VolumesListAdminTestJSON-784171213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bb0c307b-5034-47b0-8eb0-587b270e2507 tempest-VolumesListAdminTestJSON-784171213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bb0c307b-5034-47b0-8eb0-587b270e2507 tempest-VolumesListAdminTestJSON-784171213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bb0c307b-5034-47b0-8eb0-587b270e2507 tempest-VolumesListAdminTestJSON-784171213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bb0c307b-5034-47b0-8eb0-587b270e2507 tempest-VolumesListAdminTestJSON-784171213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:19 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-5dce7c79-a3a3-4a49-9d76-fe499b4f0c88 tempest-VolumesListAdminTestJSON-490636651 None] Created reservations ['1d5b9332-a3d6-4db0-a005-5620f32070ac', 'ab7319ac-bd3e-4790-8248-fc8664ddd6f8', '7e629154-c9e8-4d34-8772-1e0c24025439', 'db057a2e-b87d-4552-9669-d8426a4ab7b3'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:15:19 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:15:19 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5dce7c79-a3a3-4a49-9d76-fe499b4f0c88 tempest-VolumesListAdminTestJSON-490636651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5dce7c79-a3a3-4a49-9d76-fe499b4f0c88 tempest-VolumesListAdminTestJSON-490636651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5dce7c79-a3a3-4a49-9d76-fe499b4f0c88 tempest-VolumesListAdminTestJSON-490636651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5dce7c79-a3a3-4a49-9d76-fe499b4f0c88 tempest-VolumesListAdminTestJSON-490636651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5dce7c79-a3a3-4a49-9d76-fe499b4f0c88 tempest-VolumesListAdminTestJSON-490636651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5dce7c79-a3a3-4a49-9d76-fe499b4f0c88 tempest-VolumesListAdminTestJSON-490636651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:19 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:15:19 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:19 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9" returned: 0 in 1.036s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] <== create_volume: return (2682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:15:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.686s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:19 devstack cinder-volume[87022]: DEBUG cinder.volume.volume_utils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Attempting download of f4d67a52-db18-4750-abc4-5b7335c6e867 ((None, [{'url': 'file:///opt/stack/data/glance/images/f4d67a52-db18-4750-abc4-5b7335c6e867', 'metadata': {}}])) to volume 56bd1e78-7006-4ae6-bab0-76469c03a5e9. {{(pid=87022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:15:19 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec3516b-c3e3-4438-804c-35c37efbb64f]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4d67a52-db18-4750-abc4-5b7335c6e867_av4lgal9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:20 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4d67a52-db18-4750-abc4-5b7335c6e867_av4lgal9 Jul 08 01:15:20 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cf7239cd-4817-43ed-a02d-12d4e187508c tempest-VolumesListAdminTestJSON-490636651 None] Acquiring lock "cinder-546feb34-cf4a-44ec-9a81-38c0f18a9936-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cf7239cd-4817-43ed-a02d-12d4e187508c tempest-VolumesListAdminTestJSON-490636651 None] Lock "cinder-546feb34-cf4a-44ec-9a81-38c0f18a9936-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cf7239cd-4817-43ed-a02d-12d4e187508c tempest-VolumesListAdminTestJSON-490636651 None] Acquiring lock "cinder-quobyte-546feb34-cf4a-44ec-9a81-38c0f18a9936" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cf7239cd-4817-43ed-a02d-12d4e187508c tempest-VolumesListAdminTestJSON-490636651 None] Lock "cinder-quobyte-546feb34-cf4a-44ec-9a81-38c0f18a9936" acquired by "delete_volume" :: waited 0.028s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:20 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5385a7c-a33f-488b-b35c-890086f777e3]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cf7239cd-4817-43ed-a02d-12d4e187508c tempest-VolumesListAdminTestJSON-490636651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-546feb34-cf4a-44ec-9a81-38c0f18a9936 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:20 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bb0c307b-5034-47b0-8eb0-587b270e2507 tempest-VolumesListAdminTestJSON-784171213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.189s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:20 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-bb0c307b-5034-47b0-8eb0-587b270e2507 tempest-VolumesListAdminTestJSON-784171213 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:15:20 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-bb0c307b-5034-47b0-8eb0-587b270e2507 tempest-VolumesListAdminTestJSON-784171213 None] Deleted volume successfully. Jul 08 01:15:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bb0c307b-5034-47b0-8eb0-587b270e2507 tempest-VolumesListAdminTestJSON-784171213 None] Lock "cinder-b0c82f6d-561e-4db5-b2da-aeaf9b321168-delete_volume" released by "delete_volume" :: held 4.189s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:20 devstack sudo[96490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-546feb34-cf4a-44ec-9a81-38c0f18a9936 Jul 08 01:15:20 devstack sudo[96490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:20 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5dce7c79-a3a3-4a49-9d76-fe499b4f0c88 tempest-VolumesListAdminTestJSON-490636651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.232s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:20 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-5dce7c79-a3a3-4a49-9d76-fe499b4f0c88 tempest-VolumesListAdminTestJSON-490636651 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:15:20 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-5dce7c79-a3a3-4a49-9d76-fe499b4f0c88 tempest-VolumesListAdminTestJSON-490636651 None] Deleted volume successfully. Jul 08 01:15:20 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5dce7c79-a3a3-4a49-9d76-fe499b4f0c88 tempest-VolumesListAdminTestJSON-490636651 None] Lock "cinder-b7f4727e-dd13-449c-b18f-16817da36ec0-delete_volume" released by "delete_volume" :: held 4.145s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4d67a52-db18-4750-abc4-5b7335c6e867_av4lgal9" returned: 0 in 1.024s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4d67a52-db18-4750-abc4-5b7335c6e867_av4lgal9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:21 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4d67a52-db18-4750-abc4-5b7335c6e867_av4lgal9 Jul 08 01:15:21 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:21 devstack sudo[96490]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cf7239cd-4817-43ed-a02d-12d4e187508c tempest-VolumesListAdminTestJSON-490636651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-546feb34-cf4a-44ec-9a81-38c0f18a9936" returned: 0 in 1.022s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cf7239cd-4817-43ed-a02d-12d4e187508c tempest-VolumesListAdminTestJSON-490636651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-546feb34-cf4a-44ec-9a81-38c0f18a9936 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:21 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-546feb34-cf4a-44ec-9a81-38c0f18a9936 Jul 08 01:15:21 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:21 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4d67a52-db18-4750-abc4-5b7335c6e867_av4lgal9" returned: 1 in 0.843s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4d67a52-db18-4750-abc4-5b7335c6e867_av4lgal9' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:15:21 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f355d69-fa0f-4919-9736-01d76854496d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_6_203suwdevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:21 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_6_203suwdevstack@QuobyteHD Jul 08 01:15:21 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:22 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cf7239cd-4817-43ed-a02d-12d4e187508c tempest-VolumesListAdminTestJSON-490636651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-546feb34-cf4a-44ec-9a81-38c0f18a9936" returned: 0 in 0.898s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cf7239cd-4817-43ed-a02d-12d4e187508c tempest-VolumesListAdminTestJSON-490636651 None] Lock "cinder-quobyte-546feb34-cf4a-44ec-9a81-38c0f18a9936" released by "delete_volume" :: held 2.006s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:22 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-cf7239cd-4817-43ed-a02d-12d4e187508c tempest-VolumesListAdminTestJSON-490636651 None] Created reservations ['fbb147dc-5a11-4287-982f-9cd96d65a410', 'cb6982d7-3100-476a-a606-fd1fca702860', '7e30ab84-54bd-4a5b-9e4b-0b4579305fc0', '7f2c16a6-9a8c-4419-b690-52f2e154cd7e'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:15:22 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_6_203suwdevstack@QuobyteHD" returned: 0 in 1.006s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:22 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] f4d67a52-db18-4750-abc4-5b7335c6e867 was qcow2, converting to raw {{(pid=87022) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:15:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_6_203suwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-cf7239cd-4817-43ed-a02d-12d4e187508c tempest-VolumesListAdminTestJSON-490636651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-cf7239cd-4817-43ed-a02d-12d4e187508c tempest-VolumesListAdminTestJSON-490636651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:22 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-cf7239cd-4817-43ed-a02d-12d4e187508c tempest-VolumesListAdminTestJSON-490636651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:22 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_6_203suwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9 Jul 08 01:15:22 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-cf7239cd-4817-43ed-a02d-12d4e187508c tempest-VolumesListAdminTestJSON-490636651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-cf7239cd-4817-43ed-a02d-12d4e187508c tempest-VolumesListAdminTestJSON-490636651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cf7239cd-4817-43ed-a02d-12d4e187508c tempest-VolumesListAdminTestJSON-490636651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:22 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:22 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:15:22 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:22 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:15:22 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Flow 'volume_create_manager' (36d4e495-a169-4900-9843-ef6b8e1c10c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:22 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4407f27c-4665-4946-8cfc-a7a458848485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:22 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4407f27c-4665-4946-8cfc-a7a458848485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1243159018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dabfcbb2-9bc0-4482-999c-e9a81bb1b642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccffbbfeec64477a5ff51a09fc0cd09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:15:23Z,use_quota=True,user_id='cb1e9d487a3b410ca29b34137c9cc7fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:22 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e03a6674-a212-4130-a6b2-f71f96ce5343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:22 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e03a6674-a212-4130-a6b2-f71f96ce5343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1d5df15-6bba-41eb-9ce2-6b72bc939475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1d5df15-6bba-41eb-9ce2-6b72bc939475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dabfcbb2-9bc0-4482-999c-e9a81bb1b642', 'volume_name': 'volume-dabfcbb2-9bc0-4482-999c-e9a81bb1b642', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f4d7e3-c5ff-4618-8405-47e908fb0fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f4d7e3-c5ff-4618-8405-47e908fb0fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc4ab0e-7857-48da-9b92-133ef170f3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:23 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Volume dabfcbb2-9bc0-4482-999c-e9a81bb1b642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dabfcbb2-9bc0-4482-999c-e9a81bb1b642', 'volume_size': 1} Jul 08 01:15:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1243159018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dabfcbb2-9bc0-4482-999c-e9a81bb1b642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccffbbfeec64477a5ff51a09fc0cd09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:15:23Z,use_quota=True,user_id='cb1e9d487a3b410ca29b34137c9cc7fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:15:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Creating volume dabfcbb2-9bc0-4482-999c-e9a81bb1b642 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:15:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:15:23 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:15:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-dabfcbb2-9bc0-4482-999c-e9a81bb1b642 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:23 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cf41bc0f-7e49-429b-a5d9-492087ffe9fa tempest-VolumesListAdminTestJSON-490636651 None] Acquiring lock "cinder-3cd1a67b-9801-4479-ae75-c797040d9116-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:23 devstack sudo[96514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-dabfcbb2-9bc0-4482-999c-e9a81bb1b642 1073741824 Jul 08 01:15:23 devstack sudo[96514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:23 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cf41bc0f-7e49-429b-a5d9-492087ffe9fa tempest-VolumesListAdminTestJSON-490636651 None] Lock "cinder-3cd1a67b-9801-4479-ae75-c797040d9116-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:23 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cf41bc0f-7e49-429b-a5d9-492087ffe9fa tempest-VolumesListAdminTestJSON-490636651 None] Acquiring lock "cinder-quobyte-3cd1a67b-9801-4479-ae75-c797040d9116" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:23 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cf41bc0f-7e49-429b-a5d9-492087ffe9fa tempest-VolumesListAdminTestJSON-490636651 None] Lock "cinder-quobyte-3cd1a67b-9801-4479-ae75-c797040d9116" acquired by "delete_volume" :: waited 0.033s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:23 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23687c3-4d11-42ad-a783-192d1d823911]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cf41bc0f-7e49-429b-a5d9-492087ffe9fa tempest-VolumesListAdminTestJSON-490636651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3cd1a67b-9801-4479-ae75-c797040d9116 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:23 devstack sudo[96516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3cd1a67b-9801-4479-ae75-c797040d9116 Jul 08 01:15:23 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:23 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cf7239cd-4817-43ed-a02d-12d4e187508c tempest-VolumesListAdminTestJSON-490636651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.087s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:23 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-cf7239cd-4817-43ed-a02d-12d4e187508c tempest-VolumesListAdminTestJSON-490636651 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:15:23 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-cf7239cd-4817-43ed-a02d-12d4e187508c tempest-VolumesListAdminTestJSON-490636651 None] Deleted volume successfully. Jul 08 01:15:23 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cf7239cd-4817-43ed-a02d-12d4e187508c tempest-VolumesListAdminTestJSON-490636651 None] Lock "cinder-546feb34-cf4a-44ec-9a81-38c0f18a9936-delete_volume" released by "delete_volume" :: held 3.506s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:24 devstack sudo[96514]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-dabfcbb2-9bc0-4482-999c-e9a81bb1b642 1073741824" returned: 0 in 1.374s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-dabfcbb2-9bc0-4482-999c-e9a81bb1b642 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:24 devstack sudo[96541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-dabfcbb2-9bc0-4482-999c-e9a81bb1b642 Jul 08 01:15:24 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:24 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cf41bc0f-7e49-429b-a5d9-492087ffe9fa tempest-VolumesListAdminTestJSON-490636651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3cd1a67b-9801-4479-ae75-c797040d9116" returned: 0 in 1.208s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cf41bc0f-7e49-429b-a5d9-492087ffe9fa tempest-VolumesListAdminTestJSON-490636651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3cd1a67b-9801-4479-ae75-c797040d9116 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:24 devstack sudo[96543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3cd1a67b-9801-4479-ae75-c797040d9116 Jul 08 01:15:24 devstack sudo[96543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:25 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-dabfcbb2-9bc0-4482-999c-e9a81bb1b642" returned: 0 in 0.831s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] <== create_volume: return (2271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:15:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.275s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc4ab0e-7857-48da-9b92-133ef170f3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dabfcbb2-9bc0-4482-999c-e9a81bb1b642', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8146fa-e3d8-49ab-b8c7-64786f99f728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:25 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Volume volume-dabfcbb2-9bc0-4482-999c-e9a81bb1b642 (dabfcbb2-9bc0-4482-999c-e9a81bb1b642): created successfully Jul 08 01:15:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8146fa-e3d8-49ab-b8c7-64786f99f728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Flow 'volume_create_manager' (36d4e495-a169-4900-9843-ef6b8e1c10c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:25 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-71803c6c-8fea-4da2-a4a4-5f8cd94696ca tempest-AbsoluteLimitsTests-1493127902 None] Created volume successfully. Jul 08 01:15:25 devstack sudo[96543]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:25 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cf41bc0f-7e49-429b-a5d9-492087ffe9fa tempest-VolumesListAdminTestJSON-490636651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3cd1a67b-9801-4479-ae75-c797040d9116" returned: 0 in 0.874s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_6_203suwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9" returned: 0 in 2.703s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:25 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_6_203suwdevstack@QuobyteHD, size 112.00 MB, duration 2.71 sec, destination /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9 {{(pid=87022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:15:25 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Converted 112.00 MB image at 41.39 MB/s Jul 08 01:15:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cf41bc0f-7e49-429b-a5d9-492087ffe9fa tempest-VolumesListAdminTestJSON-490636651 None] Lock "cinder-quobyte-3cd1a67b-9801-4479-ae75-c797040d9116" released by "delete_volume" :: held 2.175s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:25 devstack sudo[96548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9 1G Jul 08 01:15:25 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:25 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-cf41bc0f-7e49-429b-a5d9-492087ffe9fa tempest-VolumesListAdminTestJSON-490636651 None] Created reservations ['d1d0ccba-1408-4335-a779-c79f913a32b7', 'b619fe54-469d-45f6-96dc-cb43b7f232b6', '87c793c3-1daa-46bd-97c4-6a2dac51d5fd', '3db2a268-34f0-4a81-b81b-1ebf05f26560'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:15:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-cf41bc0f-7e49-429b-a5d9-492087ffe9fa tempest-VolumesListAdminTestJSON-490636651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-cf41bc0f-7e49-429b-a5d9-492087ffe9fa tempest-VolumesListAdminTestJSON-490636651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-cf41bc0f-7e49-429b-a5d9-492087ffe9fa tempest-VolumesListAdminTestJSON-490636651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-cf41bc0f-7e49-429b-a5d9-492087ffe9fa tempest-VolumesListAdminTestJSON-490636651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-cf41bc0f-7e49-429b-a5d9-492087ffe9fa tempest-VolumesListAdminTestJSON-490636651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cf41bc0f-7e49-429b-a5d9-492087ffe9fa tempest-VolumesListAdminTestJSON-490636651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:25 devstack sudo[96550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:15:25 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:26 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c27d1084-2ea8-44d1-a717-dafdfc314d71 tempest-AbsoluteLimitsTests-1493127902 None] Acquiring lock "cinder-dabfcbb2-9bc0-4482-999c-e9a81bb1b642-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:26 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9 1G" returned: 0 in 0.799s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:26 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c27d1084-2ea8-44d1-a717-dafdfc314d71 tempest-AbsoluteLimitsTests-1493127902 None] Lock "cinder-dabfcbb2-9bc0-4482-999c-e9a81bb1b642-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:26 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:26 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76588af-2689-4cfd-a21d-748bf4015ea1]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cf41bc0f-7e49-429b-a5d9-492087ffe9fa tempest-VolumesListAdminTestJSON-490636651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.808s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:26 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-cf41bc0f-7e49-429b-a5d9-492087ffe9fa tempest-VolumesListAdminTestJSON-490636651 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:15:26 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c27d1084-2ea8-44d1-a717-dafdfc314d71 tempest-AbsoluteLimitsTests-1493127902 None] Acquiring lock "cinder-quobyte-dabfcbb2-9bc0-4482-999c-e9a81bb1b642" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:26 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-cf41bc0f-7e49-429b-a5d9-492087ffe9fa tempest-VolumesListAdminTestJSON-490636651 None] Deleted volume successfully. Jul 08 01:15:26 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c27d1084-2ea8-44d1-a717-dafdfc314d71 tempest-AbsoluteLimitsTests-1493127902 None] Lock "cinder-quobyte-dabfcbb2-9bc0-4482-999c-e9a81bb1b642" acquired by "delete_volume" :: waited 0.028s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:26 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cf41bc0f-7e49-429b-a5d9-492087ffe9fa tempest-VolumesListAdminTestJSON-490636651 None] Lock "cinder-3cd1a67b-9801-4479-ae75-c797040d9116-delete_volume" released by "delete_volume" :: held 3.321s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:26 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e9bd69-aede-4e96-992d-a776439e2fa2]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c27d1084-2ea8-44d1-a717-dafdfc314d71 tempest-AbsoluteLimitsTests-1493127902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-dabfcbb2-9bc0-4482-999c-e9a81bb1b642 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:26 devstack sudo[96556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9 Jul 08 01:15:26 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:26 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-dabfcbb2-9bc0-4482-999c-e9a81bb1b642 Jul 08 01:15:26 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:27 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9" returned: 0 in 1.032s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:27 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9 Jul 08 01:15:27 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:27 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c27d1084-2ea8-44d1-a717-dafdfc314d71 tempest-AbsoluteLimitsTests-1493127902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-dabfcbb2-9bc0-4482-999c-e9a81bb1b642" returned: 0 in 1.086s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c27d1084-2ea8-44d1-a717-dafdfc314d71 tempest-AbsoluteLimitsTests-1493127902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-dabfcbb2-9bc0-4482-999c-e9a81bb1b642 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:27 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-dabfcbb2-9bc0-4482-999c-e9a81bb1b642 Jul 08 01:15:27 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:28 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c27d1084-2ea8-44d1-a717-dafdfc314d71 tempest-AbsoluteLimitsTests-1493127902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-dabfcbb2-9bc0-4482-999c-e9a81bb1b642" returned: 0 in 0.841s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:28 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9" returned: 1 in 1.055s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:15:28 devstack cinder-volume[87022]: DEBUG cinder.volume.volume_utils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Downloaded image f4d67a52-db18-4750-abc4-5b7335c6e867 ((None, [{'url': 'file:///opt/stack/data/glance/images/f4d67a52-db18-4750-abc4-5b7335c6e867', 'metadata': {}}])) to volume 56bd1e78-7006-4ae6-bab0-76469c03a5e9 successfully. {{(pid=87022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:15:28 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Temporary image f4d67a52-db18-4750-abc4-5b7335c6e867 for user 8d15e43c7809417ebcb0f5f68c29ce87 is deleted. {{(pid=87022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:15:28 devstack cinder-volume[87022]: DEBUG cinder.volume.volume_utils [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Marking volume 56bd1e78-7006-4ae6-bab0-76469c03a5e9 as bootable. {{(pid=87022) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:15:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c27d1084-2ea8-44d1-a717-dafdfc314d71 tempest-AbsoluteLimitsTests-1493127902 None] Lock "cinder-quobyte-dabfcbb2-9bc0-4482-999c-e9a81bb1b642" released by "delete_volume" :: held 2.027s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:28 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Copying metadata from image f4d67a52-db18-4750-abc4-5b7335c6e867 to 56bd1e78-7006-4ae6-bab0-76469c03a5e9. {{(pid=87022) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:15:28 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Creating volume glance metadata for volume 56bd1e78-7006-4ae6-bab0-76469c03a5e9 backed by image f4d67a52-db18-4750-abc4-5b7335c6e867 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f4d67a52-db18-4750-abc4-5b7335c6e867', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87022) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:15:28 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-c27d1084-2ea8-44d1-a717-dafdfc314d71 tempest-AbsoluteLimitsTests-1493127902 None] Created reservations ['3cc076e8-8830-431e-a4b3-66b1a23e92ea', 'f7630c3f-cb9a-4d30-9b21-7cd242e5ba41', '4478ac85-ce59-4955-a919-a3ff302d35c0', '661d4cda-1138-488f-b0e7-12eb19b0b4ce'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:15:28 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=129,cinder:INSERT=41,cinder:UPDATE=179,cinder:DELETE=18 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:15:28 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0e36aff-b6a6-4294-8c69-050b58cb8402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9', 'volume_size': 1, 'image_id': 'f4d67a52-db18-4750-abc4-5b7335c6e867', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4d67a52-db18-4750-abc4-5b7335c6e867', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81fea2dfa47f49cba26ad62301512b69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4d67a52-db18-4750-abc4-5b7335c6e867', 'created_at': datetime.datetime(2026, 7, 7, 22, 58, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 22, 58, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4d67a52-db18-4750-abc4-5b7335c6e867/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:28 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea3ba69-d4dc-4897-9890-8a6419cc4c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:28 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Volume volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9 (56bd1e78-7006-4ae6-bab0-76469c03a5e9): created successfully Jul 08 01:15:28 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea3ba69-d4dc-4897-9890-8a6419cc4c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:28 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Flow 'volume_create_manager' (17bab40a-5ef8-4fdc-84da-facc3bf14499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c27d1084-2ea8-44d1-a717-dafdfc314d71 tempest-AbsoluteLimitsTests-1493127902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c27d1084-2ea8-44d1-a717-dafdfc314d71 tempest-AbsoluteLimitsTests-1493127902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:28 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c27d1084-2ea8-44d1-a717-dafdfc314d71 tempest-AbsoluteLimitsTests-1493127902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:28 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c27d1084-2ea8-44d1-a717-dafdfc314d71 tempest-AbsoluteLimitsTests-1493127902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c27d1084-2ea8-44d1-a717-dafdfc314d71 tempest-AbsoluteLimitsTests-1493127902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c27d1084-2ea8-44d1-a717-dafdfc314d71 tempest-AbsoluteLimitsTests-1493127902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:28 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-75df940a-ae10-4f54-8c7a-d56053d25245 tempest-VolumesExtendTest-323172794 None] Created volume successfully. Jul 08 01:15:28 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:15:28 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:29 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c27d1084-2ea8-44d1-a717-dafdfc314d71 tempest-AbsoluteLimitsTests-1493127902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.734s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:29 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-c27d1084-2ea8-44d1-a717-dafdfc314d71 tempest-AbsoluteLimitsTests-1493127902 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:15:29 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-c27d1084-2ea8-44d1-a717-dafdfc314d71 tempest-AbsoluteLimitsTests-1493127902 None] Deleted volume successfully. Jul 08 01:15:29 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c27d1084-2ea8-44d1-a717-dafdfc314d71 tempest-AbsoluteLimitsTests-1493127902 None] Lock "cinder-dabfcbb2-9bc0-4482-999c-e9a81bb1b642-delete_volume" released by "delete_volume" :: held 3.205s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4d8adc51-2cca-4cff-a04b-916c9dda4f4f tempest-VolumesExtendTest-323172794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4d8adc51-2cca-4cff-a04b-916c9dda4f4f tempest-VolumesExtendTest-323172794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:29 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5b2be0-b31c-46fe-8b7e-84163a40ed6a]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4d8adc51-2cca-4cff-a04b-916c9dda4f4f tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:30 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9 Jul 08 01:15:30 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:30 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4d8adc51-2cca-4cff-a04b-916c9dda4f4f tempest-VolumesExtendTest-323172794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9" returned: 0 in 0.979s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4d8adc51-2cca-4cff-a04b-916c9dda4f4f tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:31 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9 Jul 08 01:15:31 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:31 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4d8adc51-2cca-4cff-a04b-916c9dda4f4f tempest-VolumesExtendTest-323172794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9" returned: 1 in 0.921s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4d8adc51-2cca-4cff-a04b-916c9dda4f4f tempest-VolumesExtendTest-323172794 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:15:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4d8adc51-2cca-4cff-a04b-916c9dda4f4f tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9 2G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4d8adc51-2cca-4cff-a04b-916c9dda4f4f tempest-VolumesExtendTest-323172794 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9 2G" returned: 0 in 0.096s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4d8adc51-2cca-4cff-a04b-916c9dda4f4f tempest-VolumesExtendTest-323172794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.069s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:32 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-4d8adc51-2cca-4cff-a04b-916c9dda4f4f tempest-VolumesExtendTest-323172794 None] Extend volume completed successfully. Jul 08 01:15:32 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2d541bf6-f237-457a-be76-90ef440fd840 tempest-VolumesExtendTest-323172794 None] Acquiring lock "cinder-56bd1e78-7006-4ae6-bab0-76469c03a5e9-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:32 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2d541bf6-f237-457a-be76-90ef440fd840 tempest-VolumesExtendTest-323172794 None] Lock "cinder-56bd1e78-7006-4ae6-bab0-76469c03a5e9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:32 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2d541bf6-f237-457a-be76-90ef440fd840 tempest-VolumesExtendTest-323172794 None] Acquiring lock "cinder-quobyte-56bd1e78-7006-4ae6-bab0-76469c03a5e9" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:32 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2d541bf6-f237-457a-be76-90ef440fd840 tempest-VolumesExtendTest-323172794 None] Lock "cinder-quobyte-56bd1e78-7006-4ae6-bab0-76469c03a5e9" acquired by "delete_volume" :: waited 0.020s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:32 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aeebd33-484c-49c0-b401-317eb3ebe000]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2d541bf6-f237-457a-be76-90ef440fd840 tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:32 devstack sudo[96591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9 Jul 08 01:15:32 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:33 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:15:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Flow 'volume_create_manager' (cd627d40-2df1-4d16-bbb7-ddeace368266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (440cbed4-2305-41e7-ab2a-db403a0d56bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (440cbed4-2305-41e7-ab2a-db403a0d56bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1284080719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e3a785-2629-4432-a89d-07dfbe7c97ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4647e0a4084dd0910ca98c8f066bd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:15:33Z,use_quota=True,user_id='958d552070d04635aa5604db4508d370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a4fbf2-7bb7-4947-ab02-4e279bc2e234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a4fbf2-7bb7-4947-ab02-4e279bc2e234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24bf84f1-b25f-4430-a61b-c8be6a4ba92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:33 devstack cinder-volume[87022]: DEBUG cinder.image.glance [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Creating Keystone auth plugin from conf {{(pid=87022) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:15:33 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2d541bf6-f237-457a-be76-90ef440fd840 tempest-VolumesExtendTest-323172794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9" returned: 0 in 1.000s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2d541bf6-f237-457a-be76-90ef440fd840 tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:33 devstack sudo[96595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9 Jul 08 01:15:33 devstack sudo[96595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24bf84f1-b25f-4430-a61b-c8be6a4ba92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '41e3a785-2629-4432-a89d-07dfbe7c97ff', 'volume_name': 'volume-41e3a785-2629-4432-a89d-07dfbe7c97ff', 'volume_size': 1, 'image_id': 'f4d67a52-db18-4750-abc4-5b7335c6e867', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4d67a52-db18-4750-abc4-5b7335c6e867', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81fea2dfa47f49cba26ad62301512b69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4d67a52-db18-4750-abc4-5b7335c6e867', 'created_at': datetime.datetime(2026, 7, 7, 22, 58, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 22, 58, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4d67a52-db18-4750-abc4-5b7335c6e867/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c514c6ab-82e4-493a-916f-7ad81c7d134f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c514c6ab-82e4-493a-916f-7ad81c7d134f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b99cec5f-2016-4c7b-ae10-f4b8e8946052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:33 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Volume 41e3a785-2629-4432-a89d-07dfbe7c97ff: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-41e3a785-2629-4432-a89d-07dfbe7c97ff', 'volume_size': 1, 'image_id': 'f4d67a52-db18-4750-abc4-5b7335c6e867', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4d67a52-db18-4750-abc4-5b7335c6e867', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81fea2dfa47f49cba26ad62301512b69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4d67a52-db18-4750-abc4-5b7335c6e867', 'created_at': datetime.datetime(2026, 7, 7, 22, 58, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 22, 58, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4d67a52-db18-4750-abc4-5b7335c6e867/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 01:15:33 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Trying to clone 41e3a785-2629-4432-a89d-07dfbe7c97ff from image f4d67a52-db18-4750-abc4-5b7335c6e867 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f4d67a52-db18-4750-abc4-5b7335c6e867', 'metadata': {}}]). {{(pid=87022) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:15:34 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_vqbsy3l9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87022) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:15:34 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Image download 20.69 MB at 20.69 MB/s Jul 08 01:15:34 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e0d25f-b244-49e1-a95c-2c055a5644d3]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_vqbsy3l9devstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:34 devstack sudo[96595]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2d541bf6-f237-457a-be76-90ef440fd840 tempest-VolumesExtendTest-323172794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9" returned: 1 in 1.070s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2d541bf6-f237-457a-be76-90ef440fd840 tempest-VolumesExtendTest-323172794 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:15:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2d541bf6-f237-457a-be76-90ef440fd840 tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:34 devstack sudo[96602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9 Jul 08 01:15:34 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:34 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_vqbsy3l9devstack@QuobyteHD Jul 08 01:15:34 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:35 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_vqbsy3l9devstack@QuobyteHD" returned: 0 in 0.926s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:35 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Temporary image f4d67a52-db18-4750-abc4-5b7335c6e867 is fetched for user 958d552070d04635aa5604db4508d370. {{(pid=87022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:15:35 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2d541bf6-f237-457a-be76-90ef440fd840 tempest-VolumesExtendTest-323172794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56bd1e78-7006-4ae6-bab0-76469c03a5e9" returned: 0 in 0.919s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2d541bf6-f237-457a-be76-90ef440fd840 tempest-VolumesExtendTest-323172794 None] Lock "cinder-quobyte-56bd1e78-7006-4ae6-bab0-76469c03a5e9" released by "delete_volume" :: held 3.096s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:35 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef4e4d9-132d-45f2-a131-474cdae41e8d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_vqbsy3l9devstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:35 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-2d541bf6-f237-457a-be76-90ef440fd840 tempest-VolumesExtendTest-323172794 None] Created reservations ['303c5628-93dd-4879-afb6-7f58efda34ad', 'e89833d5-4e94-433d-bdb6-17c299dbcefa', '0e5e49d6-7c3a-49f6-99d0-802696181b50', '43245d25-4863-4d11-bb67-f82183fa50b7'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:15:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2d541bf6-f237-457a-be76-90ef440fd840 tempest-VolumesExtendTest-323172794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:35 devstack sudo[96609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_vqbsy3l9devstack@QuobyteHD Jul 08 01:15:35 devstack sudo[96609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2d541bf6-f237-457a-be76-90ef440fd840 tempest-VolumesExtendTest-323172794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:35 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-2d541bf6-f237-457a-be76-90ef440fd840 tempest-VolumesExtendTest-323172794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:35 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-2d541bf6-f237-457a-be76-90ef440fd840 tempest-VolumesExtendTest-323172794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2d541bf6-f237-457a-be76-90ef440fd840 tempest-VolumesExtendTest-323172794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2d541bf6-f237-457a-be76-90ef440fd840 tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:35 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:15:35 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:36 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:15:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Flow 'volume_create_manager' (d01006ae-0bb6-4af2-8a1f-60c18dabac9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02fadb1c-d63b-4f05-bf74-1605d1bd4a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02fadb1c-d63b-4f05-bf74-1605d1bd4a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-354447793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=258c64b2-4a45-4684-9ccb-0e9a4d438b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614f7f74835947d59715a45908c14ee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:15:36Z,use_quota=True,user_id='8f38f8e55b114e53aef35d33b4fa5308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6aa2ca2-30ec-48d8-92ae-4cc51bd87ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6aa2ca2-30ec-48d8-92ae-4cc51bd87ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (046cc52b-2319-4ee7-bb4d-f362bf84f4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (046cc52b-2319-4ee7-bb4d-f362bf84f4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '258c64b2-4a45-4684-9ccb-0e9a4d438b95', 'volume_name': 'volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0701fc48-4fda-40f9-848d-a51f35fa83f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0701fc48-4fda-40f9-848d-a51f35fa83f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86aa5bd0-7f4b-4a13-b201-31fa17ff8851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:36 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Volume 258c64b2-4a45-4684-9ccb-0e9a4d438b95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95', 'volume_size': 1} Jul 08 01:15:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-354447793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=258c64b2-4a45-4684-9ccb-0e9a4d438b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614f7f74835947d59715a45908c14ee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:15:36Z,use_quota=True,user_id='8f38f8e55b114e53aef35d33b4fa5308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:15:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Creating volume 258c64b2-4a45-4684-9ccb-0e9a4d438b95 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:15:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:15:36 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:15:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:36 devstack sudo[96613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95 1073741824 Jul 08 01:15:36 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:36 devstack sudo[96609]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_vqbsy3l9devstack@QuobyteHD" returned: 0 in 1.100s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:36 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2d541bf6-f237-457a-be76-90ef440fd840 tempest-VolumesExtendTest-323172794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.918s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:36 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-2d541bf6-f237-457a-be76-90ef440fd840 tempest-VolumesExtendTest-323172794 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:15:36 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-2d541bf6-f237-457a-be76-90ef440fd840 tempest-VolumesExtendTest-323172794 None] Deleted volume successfully. Jul 08 01:15:36 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2d541bf6-f237-457a-be76-90ef440fd840 tempest-VolumesExtendTest-323172794 None] Lock "cinder-56bd1e78-7006-4ae6-bab0-76469c03a5e9-delete_volume" released by "delete_volume" :: held 4.353s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:37 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:15:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Flow 'volume_create_manager' (0f01b01c-8221-448d-ba3d-44eb19dc3ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df32fecf-9498-4d9d-9202-ff69baace3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df32fecf-9498-4d9d-9202-ff69baace3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-615400774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99b50d7a-0682-438f-b622-462d873ae18f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74f3324813284511906091e2ac65bcca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:15:37Z,use_quota=True,user_id='8d15e43c7809417ebcb0f5f68c29ce87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca43a55-c3b8-461e-a893-578117434964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca43a55-c3b8-461e-a893-578117434964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c9d63bb-b7f2-4471-99dc-5e486e28f94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c9d63bb-b7f2-4471-99dc-5e486e28f94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99b50d7a-0682-438f-b622-462d873ae18f', 'volume_name': 'volume-99b50d7a-0682-438f-b622-462d873ae18f', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:37 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919f8e43-43a0-4685-9ac0-44fd0e1d277f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919f8e43-43a0-4685-9ac0-44fd0e1d277f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a48371e1-f8af-4930-9c3b-465f28ad4f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:37 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Volume 99b50d7a-0682-438f-b622-462d873ae18f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99b50d7a-0682-438f-b622-462d873ae18f', 'volume_size': 1} Jul 08 01:15:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95 1073741824" returned: 0 in 1.119s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:37 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95 Jul 08 01:15:37 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:38 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95" returned: 0 in 0.768s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] <== create_volume: return (1944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:15:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.947s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.658s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1284080719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e3a785-2629-4432-a89d-07dfbe7c97ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4647e0a4084dd0910ca98c8f066bd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:15:33Z,use_quota=True,user_id='958d552070d04635aa5604db4508d370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:15:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Creating volume 41e3a785-2629-4432-a89d-07dfbe7c97ff {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:15:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:15:38 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:15:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86aa5bd0-7f4b-4a13-b201-31fa17ff8851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:38 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff 1073741824 Jul 08 01:15:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe0f125-9f5d-48af-9b1a-5935d65502d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:38 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:38 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Volume volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95 (258c64b2-4a45-4684-9ccb-0e9a4d438b95): created successfully Jul 08 01:15:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe0f125-9f5d-48af-9b1a-5935d65502d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Flow 'volume_create_manager' (d01006ae-0bb6-4af2-8a1f-60c18dabac9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:38 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-2af45669-f649-49c5-b9a8-8ab3fe12ff07 tempest-VolumesDeleteCascade-165698782 None] Created volume successfully. Jul 08 01:15:39 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff 1073741824" returned: 0 in 1.113s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:39 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff Jul 08 01:15:39 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d1eb7679-21fe-4ae8-8f42-29a45508263f tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:40 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff" returned: 0 in 0.830s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:40 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:15:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.005s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.830s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:40 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-615400774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99b50d7a-0682-438f-b622-462d873ae18f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74f3324813284511906091e2ac65bcca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:15:37Z,use_quota=True,user_id='8d15e43c7809417ebcb0f5f68c29ce87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:15:40 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Creating volume 99b50d7a-0682-438f-b622-462d873ae18f {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:15:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:40 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:40 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:40 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:15:40 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:15:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:40 devstack sudo[96637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f 1073741824 Jul 08 01:15:40 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:40 devstack cinder-volume[87022]: DEBUG cinder.volume.volume_utils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Attempting download of f4d67a52-db18-4750-abc4-5b7335c6e867 ((None, [{'url': 'file:///opt/stack/data/glance/images/f4d67a52-db18-4750-abc4-5b7335c6e867', 'metadata': {}}])) to volume 41e3a785-2629-4432-a89d-07dfbe7c97ff. {{(pid=87022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:15:40 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae41847-cdd5-4b9c-a3ca-e710b178c601]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4d67a52-db18-4750-abc4-5b7335c6e867_v7r4fizr {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:40 devstack sudo[96639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4d67a52-db18-4750-abc4-5b7335c6e867_v7r4fizr Jul 08 01:15:40 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:41 devstack sudo[96637]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f 1073741824" returned: 0 in 1.284s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:41 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4d67a52-db18-4750-abc4-5b7335c6e867_v7r4fizr" returned: 0 in 1.182s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4d67a52-db18-4750-abc4-5b7335c6e867_v7r4fizr {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:41 devstack sudo[96648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f Jul 08 01:15:41 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:41 devstack sudo[96647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4d67a52-db18-4750-abc4-5b7335c6e867_v7r4fizr Jul 08 01:15:42 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:42 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f" returned: 0 in 0.932s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:42 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] <== create_volume: return (2320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:15:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.323s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d1eb7679-21fe-4ae8-8f42-29a45508263f tempest-VolumesDeleteCascade-165698782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.919s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:42 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4d67a52-db18-4750-abc4-5b7335c6e867_v7r4fizr" returned: 1 in 0.975s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4d67a52-db18-4750-abc4-5b7335c6e867_v7r4fizr' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:15:42 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[9983f265-2693-42f8-9e71-d3749bc72843]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_vqbsy3l9devstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a48371e1-f8af-4930-9c3b-465f28ad4f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99b50d7a-0682-438f-b622-462d873ae18f', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418f7543-3e6f-46c0-b1e0-4bec5fc1b84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:42 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-d1eb7679-21fe-4ae8-8f42-29a45508263f tempest-VolumesDeleteCascade-165698782 None] Creating offline snapshot 7784b523-8263-4e11-a65a-6b8754605069 of volume 258c64b2-4a45-4684-9ccb-0e9a4d438b95 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:15:42 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Volume volume-99b50d7a-0682-438f-b622-462d873ae18f (99b50d7a-0682-438f-b622-462d873ae18f): created successfully Jul 08 01:15:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418f7543-3e6f-46c0-b1e0-4bec5fc1b84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Flow 'volume_create_manager' (0f01b01c-8221-448d-ba3d-44eb19dc3ae3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:42 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d929d50-c52f-49ab-8249-5e320bcea8a7]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d1eb7679-21fe-4ae8-8f42-29a45508263f tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:42 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-12918b69-4375-47f8-923d-0aef665a80eb tempest-VolumesExtendTest-323172794 None] Created volume successfully. Jul 08 01:15:42 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_vqbsy3l9devstack@QuobyteHD Jul 08 01:15:42 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:43 devstack sudo[96655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95 Jul 08 01:15:43 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:43 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_vqbsy3l9devstack@QuobyteHD" returned: 0 in 1.045s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:43 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] f4d67a52-db18-4750-abc4-5b7335c6e867 was qcow2, converting to raw {{(pid=87022) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:15:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_vqbsy3l9devstack@QuobyteHD /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:43 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d1eb7679-21fe-4ae8-8f42-29a45508263f tempest-VolumesDeleteCascade-165698782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95" returned: 0 in 0.989s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d1eb7679-21fe-4ae8-8f42-29a45508263f tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:43 devstack sudo[96665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_vqbsy3l9devstack@QuobyteHD /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff Jul 08 01:15:43 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:43 devstack sudo[96666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069 1G Jul 08 01:15:43 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ec12dd93-3edf-468c-beda-0e608ea286af tempest-VolumesExtendTest-323172794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d1eb7679-21fe-4ae8-8f42-29a45508263f tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069 1G" returned: 0 in 1.300s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:45 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d1eb7679-21fe-4ae8-8f42-29a45508263f tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:45 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069 Jul 08 01:15:45 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:45 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:15:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:45 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:15:45 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:46 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d1eb7679-21fe-4ae8-8f42-29a45508263f tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069" returned: 0 in 0.917s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:46 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-d1eb7679-21fe-4ae8-8f42-29a45508263f tempest-VolumesDeleteCascade-165698782 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069 is being set with open permissions: ugo+rw Jul 08 01:15:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d1eb7679-21fe-4ae8-8f42-29a45508263f tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:46 devstack sudo[96690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069 Jul 08 01:15:46 devstack sudo[96690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:46 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.759s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:46 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:15:46 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:15:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread count: 28 {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:15:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread info: [<_MainThread(MainThread, started 134382216167552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:15:46 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_vqbsy3l9devstack@QuobyteHD /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff" returned: 0 in 2.620s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:46 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_vqbsy3l9devstack@QuobyteHD, size 112.00 MB, duration 2.62 sec, destination /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff {{(pid=87022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:15:46 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Converted 112.00 MB image at 42.73 MB/s Jul 08 01:15:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:46 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff 1G Jul 08 01:15:46 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:46 devstack sudo[96690]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d1eb7679-21fe-4ae8-8f42-29a45508263f tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069" returned: 0 in 0.777s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d1eb7679-21fe-4ae8-8f42-29a45508263f tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:46 devstack sudo[96695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.info Jul 08 01:15:46 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:47 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff 1G" returned: 0 in 0.768s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:47 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5dca81-d7cd-4ca3-bba5-011a7a792268]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:47 devstack sudo[96701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff Jul 08 01:15:47 devstack sudo[96701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:47 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d1eb7679-21fe-4ae8-8f42-29a45508263f tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.info" returned: 0 in 0.742s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:47 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-d1eb7679-21fe-4ae8-8f42-29a45508263f tempest-VolumesDeleteCascade-165698782 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.info is being set with open permissions: ugo+rw Jul 08 01:15:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d1eb7679-21fe-4ae8-8f42-29a45508263f tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:47 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.info Jul 08 01:15:47 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:48 devstack sudo[96701]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff" returned: 0 in 0.814s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:48 devstack sudo[96708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff Jul 08 01:15:48 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:48 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d1eb7679-21fe-4ae8-8f42-29a45508263f tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.info" returned: 0 in 0.690s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d1eb7679-21fe-4ae8-8f42-29a45508263f tempest-VolumesDeleteCascade-165698782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.608s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ec12dd93-3edf-468c-beda-0e608ea286af tempest-VolumesExtendTest-323172794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.939s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:48 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-ec12dd93-3edf-468c-beda-0e608ea286af tempest-VolumesExtendTest-323172794 None] Creating offline snapshot 1a9998c9-489e-4d8d-af2e-7f4feb700411 of volume 99b50d7a-0682-438f-b622-462d873ae18f {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:15:48 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-d1eb7679-21fe-4ae8-8f42-29a45508263f tempest-VolumesDeleteCascade-165698782 None] Create snapshot completed successfully Jul 08 01:15:48 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4907c414-4da6-4d87-9e14-3cd9a6046a31]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ec12dd93-3edf-468c-beda-0e608ea286af tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:48 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f Jul 08 01:15:48 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:48 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff" returned: 1 in 0.836s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:15:48 devstack cinder-volume[87022]: DEBUG cinder.volume.volume_utils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Downloaded image f4d67a52-db18-4750-abc4-5b7335c6e867 ((None, [{'url': 'file:///opt/stack/data/glance/images/f4d67a52-db18-4750-abc4-5b7335c6e867', 'metadata': {}}])) to volume 41e3a785-2629-4432-a89d-07dfbe7c97ff successfully. {{(pid=87022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:15:48 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Temporary image f4d67a52-db18-4750-abc4-5b7335c6e867 for user 958d552070d04635aa5604db4508d370 is deleted. {{(pid=87022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:15:48 devstack cinder-volume[87022]: DEBUG cinder.volume.volume_utils [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Marking volume 41e3a785-2629-4432-a89d-07dfbe7c97ff as bootable. {{(pid=87022) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:15:48 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Copying metadata from image f4d67a52-db18-4750-abc4-5b7335c6e867 to 41e3a785-2629-4432-a89d-07dfbe7c97ff. {{(pid=87022) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:15:48 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Creating volume glance metadata for volume 41e3a785-2629-4432-a89d-07dfbe7c97ff backed by image f4d67a52-db18-4750-abc4-5b7335c6e867 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f4d67a52-db18-4750-abc4-5b7335c6e867', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87022) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:15:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b99cec5f-2016-4c7b-ae10-f4b8e8946052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41e3a785-2629-4432-a89d-07dfbe7c97ff', 'volume_size': 1, 'image_id': 'f4d67a52-db18-4750-abc4-5b7335c6e867', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4d67a52-db18-4750-abc4-5b7335c6e867', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81fea2dfa47f49cba26ad62301512b69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4d67a52-db18-4750-abc4-5b7335c6e867', 'created_at': datetime.datetime(2026, 7, 7, 22, 58, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 22, 58, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4d67a52-db18-4750-abc4-5b7335c6e867/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f242fb1f-3bd3-4e51-a211-d708529d29c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:49 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Volume volume-41e3a785-2629-4432-a89d-07dfbe7c97ff (41e3a785-2629-4432-a89d-07dfbe7c97ff): created successfully Jul 08 01:15:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f242fb1f-3bd3-4e51-a211-d708529d29c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Flow 'volume_create_manager' (cd627d40-2df1-4d16-bbb7-ddeace368266) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:49 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-5d034e99-dac6-4eb9-b302-12867193cb08 tempest-VolumesImageMetadata-788980709 None] Created volume successfully. Jul 08 01:15:49 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ec12dd93-3edf-468c-beda-0e608ea286af tempest-VolumesExtendTest-323172794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f" returned: 0 in 0.863s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ec12dd93-3edf-468c-beda-0e608ea286af tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f.1a9998c9-489e-4d8d-af2e-7f4feb700411 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:49 devstack sudo[96719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f.1a9998c9-489e-4d8d-af2e-7f4feb700411 1G Jul 08 01:15:49 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-aa7729c4-7c35-4e7c-8683-68e22c4840de tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:50 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ec12dd93-3edf-468c-beda-0e608ea286af tempest-VolumesExtendTest-323172794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f.1a9998c9-489e-4d8d-af2e-7f4feb700411 1G" returned: 0 in 1.037s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ec12dd93-3edf-468c-beda-0e608ea286af tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99b50d7a-0682-438f-b622-462d873ae18f -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f.1a9998c9-489e-4d8d-af2e-7f4feb700411 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:50 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99b50d7a-0682-438f-b622-462d873ae18f -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f.1a9998c9-489e-4d8d-af2e-7f4feb700411 Jul 08 01:15:50 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d57914f0-e76b-4f1e-8975-9ec71db21b59 tempest-VolumesImageMetadata-788980709 None] Acquiring lock "cinder-41e3a785-2629-4432-a89d-07dfbe7c97ff-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d57914f0-e76b-4f1e-8975-9ec71db21b59 tempest-VolumesImageMetadata-788980709 None] Lock "cinder-41e3a785-2629-4432-a89d-07dfbe7c97ff-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d57914f0-e76b-4f1e-8975-9ec71db21b59 tempest-VolumesImageMetadata-788980709 None] Acquiring lock "cinder-quobyte-41e3a785-2629-4432-a89d-07dfbe7c97ff" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d57914f0-e76b-4f1e-8975-9ec71db21b59 tempest-VolumesImageMetadata-788980709 None] Lock "cinder-quobyte-41e3a785-2629-4432-a89d-07dfbe7c97ff" acquired by "delete_volume" :: waited 0.022s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:50 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccfef94-4c99-49dc-abb0-30a76e1baa85]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d57914f0-e76b-4f1e-8975-9ec71db21b59 tempest-VolumesImageMetadata-788980709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:50 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff Jul 08 01:15:50 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:51 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ec12dd93-3edf-468c-beda-0e608ea286af tempest-VolumesExtendTest-323172794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99b50d7a-0682-438f-b622-462d873ae18f -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f.1a9998c9-489e-4d8d-af2e-7f4feb700411" returned: 0 in 0.784s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:51 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-ec12dd93-3edf-468c-beda-0e608ea286af tempest-VolumesExtendTest-323172794 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f.1a9998c9-489e-4d8d-af2e-7f4feb700411 is being set with open permissions: ugo+rw Jul 08 01:15:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ec12dd93-3edf-468c-beda-0e608ea286af tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f.1a9998c9-489e-4d8d-af2e-7f4feb700411 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:51 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f.1a9998c9-489e-4d8d-af2e-7f4feb700411 Jul 08 01:15:51 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:51 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d57914f0-e76b-4f1e-8975-9ec71db21b59 tempest-VolumesImageMetadata-788980709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff" returned: 0 in 0.879s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d57914f0-e76b-4f1e-8975-9ec71db21b59 tempest-VolumesImageMetadata-788980709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:51 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff Jul 08 01:15:51 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:51 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ec12dd93-3edf-468c-beda-0e608ea286af tempest-VolumesExtendTest-323172794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f.1a9998c9-489e-4d8d-af2e-7f4feb700411" returned: 0 in 0.811s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ec12dd93-3edf-468c-beda-0e608ea286af tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:51 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f.info Jul 08 01:15:51 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:52 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d57914f0-e76b-4f1e-8975-9ec71db21b59 tempest-VolumesImageMetadata-788980709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff" returned: 1 in 1.009s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d57914f0-e76b-4f1e-8975-9ec71db21b59 tempest-VolumesImageMetadata-788980709 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:15:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d57914f0-e76b-4f1e-8975-9ec71db21b59 tempest-VolumesImageMetadata-788980709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:52 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff Jul 08 01:15:52 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:52 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ec12dd93-3edf-468c-beda-0e608ea286af tempest-VolumesExtendTest-323172794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f.info" returned: 0 in 0.889s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:52 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-ec12dd93-3edf-468c-beda-0e608ea286af tempest-VolumesExtendTest-323172794 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f.info is being set with open permissions: ugo+rw Jul 08 01:15:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ec12dd93-3edf-468c-beda-0e608ea286af tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:52 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f.info Jul 08 01:15:52 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:53 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d57914f0-e76b-4f1e-8975-9ec71db21b59 tempest-VolumesImageMetadata-788980709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41e3a785-2629-4432-a89d-07dfbe7c97ff" returned: 0 in 0.824s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:53 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d57914f0-e76b-4f1e-8975-9ec71db21b59 tempest-VolumesImageMetadata-788980709 None] Lock "cinder-quobyte-41e3a785-2629-4432-a89d-07dfbe7c97ff" released by "delete_volume" :: held 2.804s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:53 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-d57914f0-e76b-4f1e-8975-9ec71db21b59 tempest-VolumesImageMetadata-788980709 None] Created reservations ['09c9684f-d7e3-4046-8b8e-e2b5290c5a33', 'c17e5d8c-d48e-4977-9c98-772758f5007e', '7a7a199c-e3dc-4427-890e-e522a9b46849', '144965a9-7a6f-45f0-beb1-bcf31aacead6'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:15:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d57914f0-e76b-4f1e-8975-9ec71db21b59 tempest-VolumesImageMetadata-788980709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d57914f0-e76b-4f1e-8975-9ec71db21b59 tempest-VolumesImageMetadata-788980709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:53 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d57914f0-e76b-4f1e-8975-9ec71db21b59 tempest-VolumesImageMetadata-788980709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:53 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d57914f0-e76b-4f1e-8975-9ec71db21b59 tempest-VolumesImageMetadata-788980709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d57914f0-e76b-4f1e-8975-9ec71db21b59 tempest-VolumesImageMetadata-788980709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d57914f0-e76b-4f1e-8975-9ec71db21b59 tempest-VolumesImageMetadata-788980709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:53 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:15:53 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:53 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ec12dd93-3edf-468c-beda-0e608ea286af tempest-VolumesExtendTest-323172794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f.info" returned: 0 in 0.902s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ec12dd93-3edf-468c-beda-0e608ea286af tempest-VolumesExtendTest-323172794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.423s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-aa7729c4-7c35-4e7c-8683-68e22c4840de tempest-VolumesDeleteCascade-165698782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.280s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:53 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-ec12dd93-3edf-468c-beda-0e608ea286af tempest-VolumesExtendTest-323172794 None] Create snapshot completed successfully Jul 08 01:15:53 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-aa7729c4-7c35-4e7c-8683-68e22c4840de tempest-VolumesDeleteCascade-165698782 None] Creating offline snapshot 7207891f-db3c-434a-9b05-46ccac83cc67 of volume 258c64b2-4a45-4684-9ccb-0e9a4d438b95 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:15:53 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef262935-ffb7-4653-b934-6052f0e8d451]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-aa7729c4-7c35-4e7c-8683-68e22c4840de tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:54 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069 Jul 08 01:15:54 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:54 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d57914f0-e76b-4f1e-8975-9ec71db21b59 tempest-VolumesImageMetadata-788980709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.915s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:54 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-d57914f0-e76b-4f1e-8975-9ec71db21b59 tempest-VolumesImageMetadata-788980709 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:15:54 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-d57914f0-e76b-4f1e-8975-9ec71db21b59 tempest-VolumesImageMetadata-788980709 None] Deleted volume successfully. Jul 08 01:15:54 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d57914f0-e76b-4f1e-8975-9ec71db21b59 tempest-VolumesImageMetadata-788980709 None] Lock "cinder-41e3a785-2629-4432-a89d-07dfbe7c97ff-delete_volume" released by "delete_volume" :: held 4.033s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ee6e13f6-0869-44a9-9b98-9c96c5c40723 tempest-VolumesExtendTest-323172794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:55 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-aa7729c4-7c35-4e7c-8683-68e22c4840de tempest-VolumesDeleteCascade-165698782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069" returned: 0 in 1.268s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:55 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-aa7729c4-7c35-4e7c-8683-68e22c4840de tempest-VolumesDeleteCascade-165698782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:15:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-aa7729c4-7c35-4e7c-8683-68e22c4840de tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7207891f-db3c-434a-9b05-46ccac83cc67 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:55 devstack sudo[96759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7207891f-db3c-434a-9b05-46ccac83cc67 1G Jul 08 01:15:55 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:56 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-aa7729c4-7c35-4e7c-8683-68e22c4840de tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7207891f-db3c-434a-9b05-46ccac83cc67 1G" returned: 0 in 1.176s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-aa7729c4-7c35-4e7c-8683-68e22c4840de tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7207891f-db3c-434a-9b05-46ccac83cc67 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:56 devstack sudo[96765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7207891f-db3c-434a-9b05-46ccac83cc67 Jul 08 01:15:56 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:57 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-aa7729c4-7c35-4e7c-8683-68e22c4840de tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7207891f-db3c-434a-9b05-46ccac83cc67" returned: 0 in 0.909s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:57 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-aa7729c4-7c35-4e7c-8683-68e22c4840de tempest-VolumesDeleteCascade-165698782 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7207891f-db3c-434a-9b05-46ccac83cc67 is being set with open permissions: ugo+rw Jul 08 01:15:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-aa7729c4-7c35-4e7c-8683-68e22c4840de tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7207891f-db3c-434a-9b05-46ccac83cc67 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:57 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7207891f-db3c-434a-9b05-46ccac83cc67 Jul 08 01:15:57 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:57 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:15:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Flow 'volume_create_manager' (cd4cfc16-d650-46a4-8427-9fd97a0005e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a573296-6a58-4eff-8c86-af3b1f26bc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a573296-6a58-4eff-8c86-af3b1f26bc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1482256726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=934eab9a-596a-4417-9404-7c9b5572cfda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df80dbe481754a048ff777d2222545f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:15:58Z,use_quota=True,user_id='cce2e510d6324154864991ec0a783cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f27dbf-1047-4c8a-bdd5-4aa7f78386b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f27dbf-1047-4c8a-bdd5-4aa7f78386b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca0331e-8525-4d76-ad84-683b93e3d843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca0331e-8525-4d76-ad84-683b93e3d843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '934eab9a-596a-4417-9404-7c9b5572cfda', 'volume_name': 'volume-934eab9a-596a-4417-9404-7c9b5572cfda', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ee1b64-bf71-4e7d-a83b-8accc1721b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ee1b64-bf71-4e7d-a83b-8accc1721b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d37efd-430e-4a70-9bc0-0ad230105db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:57 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Volume 934eab9a-596a-4417-9404-7c9b5572cfda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-934eab9a-596a-4417-9404-7c9b5572cfda', 'volume_size': 1} Jul 08 01:15:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:58 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-aa7729c4-7c35-4e7c-8683-68e22c4840de tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7207891f-db3c-434a-9b05-46ccac83cc67" returned: 0 in 0.886s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-aa7729c4-7c35-4e7c-8683-68e22c4840de tempest-VolumesDeleteCascade-165698782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.427s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ee6e13f6-0869-44a9-9b98-9c96c5c40723 tempest-VolumesExtendTest-323172794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 3.076s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:58 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aef2b68-d917-4f59-8393-5845dbd79a84]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ee6e13f6-0869-44a9-9b98-9c96c5c40723 tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:58 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-aa7729c4-7c35-4e7c-8683-68e22c4840de tempest-VolumesDeleteCascade-165698782 None] Create snapshot completed successfully Jul 08 01:15:58 devstack sudo[96774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f Jul 08 01:15:58 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:59 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "cinder-258c64b2-4a45-4684-9ccb-0e9a4d438b95-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:59 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-258c64b2-4a45-4684-9ccb-0e9a4d438b95-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Performing cascade delete. {{(pid=87022) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 01:15:59 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "cinder-7207891f-db3c-434a-9b05-46ccac83cc67-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:59 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:59 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-7207891f-db3c-434a-9b05-46ccac83cc67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ee6e13f6-0869-44a9-9b98-9c96c5c40723 tempest-VolumesExtendTest-323172794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f" returned: 0 in 0.920s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ee6e13f6-0869-44a9-9b98-9c96c5c40723 tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f.1a9998c9-489e-4d8d-af2e-7f4feb700411 2G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:59 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "cinder-quobyte-258c64b2-4a45-4684-9ccb-0e9a4d438b95" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:59 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-quobyte-258c64b2-4a45-4684-9ccb-0e9a4d438b95" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:59 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "cinder-quobyte-7207891f-db3c-434a-9b05-46ccac83cc67" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:59 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-quobyte-7207891f-db3c-434a-9b05-46ccac83cc67" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Deleting offline snapshot 7207891f-db3c-434a-9b05-46ccac83cc67 of volume 258c64b2-4a45-4684-9ccb-0e9a4d438b95 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:15:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] snapshot_file for this snap is: volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7207891f-db3c-434a-9b05-46ccac83cc67 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:15:59 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1eab9dd-e1c9-4533-8f5f-cc48a45c30a8]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7207891f-db3c-434a-9b05-46ccac83cc67 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ee6e13f6-0869-44a9-9b98-9c96c5c40723 tempest-VolumesExtendTest-323172794 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f.1a9998c9-489e-4d8d-af2e-7f4feb700411 2G" returned: 0 in 0.177s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ee6e13f6-0869-44a9-9b98-9c96c5c40723 tempest-VolumesExtendTest-323172794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.147s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.577s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1482256726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=934eab9a-596a-4417-9404-7c9b5572cfda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df80dbe481754a048ff777d2222545f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:15:58Z,use_quota=True,user_id='cce2e510d6324154864991ec0a783cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:15:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Creating volume 934eab9a-596a-4417-9404-7c9b5572cfda {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:15:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:15:59 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:15:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-934eab9a-596a-4417-9404-7c9b5572cfda 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:59 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-934eab9a-596a-4417-9404-7c9b5572cfda 1073741824 Jul 08 01:15:59 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:59 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7207891f-db3c-434a-9b05-46ccac83cc67 Jul 08 01:15:59 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:59 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-ee6e13f6-0869-44a9-9b98-9c96c5c40723 tempest-VolumesExtendTest-323172794 None] Extend volume completed successfully. Jul 08 01:16:00 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7207891f-db3c-434a-9b05-46ccac83cc67" returned: 0 in 0.963s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:00 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:16:00 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2444a4ad-670e-4290-8a10-fe3a67f68fbd]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:00 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-934eab9a-596a-4417-9404-7c9b5572cfda 1073741824" returned: 0 in 0.994s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:00 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069 Jul 08 01:16:00 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-934eab9a-596a-4417-9404-7c9b5572cfda {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:00 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-934eab9a-596a-4417-9404-7c9b5572cfda Jul 08 01:16:00 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:00 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-40cefd4e-162a-4609-8335-d010720ae859 tempest-VolumesExtendTest-323172794 None] Acquiring lock "cinder-1a9998c9-489e-4d8d-af2e-7f4feb700411-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:00 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-40cefd4e-162a-4609-8335-d010720ae859 tempest-VolumesExtendTest-323172794 None] Lock "cinder-1a9998c9-489e-4d8d-af2e-7f4feb700411-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:00 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-40cefd4e-162a-4609-8335-d010720ae859 tempest-VolumesExtendTest-323172794 None] Acquiring lock "cinder-quobyte-99b50d7a-0682-438f-b622-462d873ae18f" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:00 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-40cefd4e-162a-4609-8335-d010720ae859 tempest-VolumesExtendTest-323172794 None] Lock "cinder-quobyte-99b50d7a-0682-438f-b622-462d873ae18f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:00 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-40cefd4e-162a-4609-8335-d010720ae859 tempest-VolumesExtendTest-323172794 None] Acquiring lock "cinder-quobyte-1a9998c9-489e-4d8d-af2e-7f4feb700411" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:00 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-40cefd4e-162a-4609-8335-d010720ae859 tempest-VolumesExtendTest-323172794 None] Lock "cinder-quobyte-1a9998c9-489e-4d8d-af2e-7f4feb700411" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:00 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-40cefd4e-162a-4609-8335-d010720ae859 tempest-VolumesExtendTest-323172794 None] Deleting offline snapshot 1a9998c9-489e-4d8d-af2e-7f4feb700411 of volume 99b50d7a-0682-438f-b622-462d873ae18f {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:16:00 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-40cefd4e-162a-4609-8335-d010720ae859 tempest-VolumesExtendTest-323172794 None] snapshot_file for this snap is: volume-99b50d7a-0682-438f-b622-462d873ae18f.1a9998c9-489e-4d8d-af2e-7f4feb700411 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:16:00 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[609b0910-db3e-4b3b-93b9-4f9e4c50b055]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-40cefd4e-162a-4609-8335-d010720ae859 tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f.1a9998c9-489e-4d8d-af2e-7f4feb700411 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:01 devstack sudo[96796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f.1a9998c9-489e-4d8d-af2e-7f4feb700411 Jul 08 01:16:01 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:01 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-934eab9a-596a-4417-9404-7c9b5572cfda" returned: 0 in 0.928s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] <== create_volume: return (1978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:16:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.983s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d37efd-430e-4a70-9bc0-0ad230105db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-934eab9a-596a-4417-9404-7c9b5572cfda', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e0128d-f158-44cc-bcd2-69b39b51dcec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:01 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Volume volume-934eab9a-596a-4417-9404-7c9b5572cfda (934eab9a-596a-4417-9404-7c9b5572cfda): created successfully Jul 08 01:16:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e0128d-f158-44cc-bcd2-69b39b51dcec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Flow 'volume_create_manager' (cd4cfc16-d650-46a4-8427-9fd97a0005e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:16:01 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-d60701a8-e6b3-453e-aae6-bdeaa39751a2 tempest-VolumesMetadataTest-487109641 None] Created volume successfully. Jul 08 01:16:01 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069" returned: 0 in 1.152s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:16:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7207891f-db3c-434a-9b05-46ccac83cc67 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:01 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7207891f-db3c-434a-9b05-46ccac83cc67 Jul 08 01:16:01 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:01 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-40cefd4e-162a-4609-8335-d010720ae859 tempest-VolumesExtendTest-323172794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f.1a9998c9-489e-4d8d-af2e-7f4feb700411" returned: 0 in 1.032s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-40cefd4e-162a-4609-8335-d010720ae859 tempest-VolumesExtendTest-323172794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99b50d7a-0682-438f-b622-462d873ae18f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:16:02 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e33701-53da-41e0-a68b-0c715ae849dd]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-40cefd4e-162a-4609-8335-d010720ae859 tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:02 devstack sudo[96807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f Jul 08 01:16:02 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:02 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7207891f-db3c-434a-9b05-46ccac83cc67" returned: 0 in 1.215s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7207891f-db3c-434a-9b05-46ccac83cc67 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:02 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7207891f-db3c-434a-9b05-46ccac83cc67 Jul 08 01:16:02 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:02 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-9df9b63c-f323-49bb-8b20-9ef26be62ae9 tempest-VolumesMetadataTest-487109641 None] Acquiring lock "cinder-934eab9a-596a-4417-9404-7c9b5572cfda-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:02 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-9df9b63c-f323-49bb-8b20-9ef26be62ae9 tempest-VolumesMetadataTest-487109641 None] Lock "cinder-934eab9a-596a-4417-9404-7c9b5572cfda-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:02 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:UPDATE=146,cinder:DELETE=11,cinder:SELECT=115,cinder:INSERT=49 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:16:03 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-9df9b63c-f323-49bb-8b20-9ef26be62ae9 tempest-VolumesMetadataTest-487109641 None] Acquiring lock "cinder-quobyte-934eab9a-596a-4417-9404-7c9b5572cfda" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:03 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-9df9b63c-f323-49bb-8b20-9ef26be62ae9 tempest-VolumesMetadataTest-487109641 None] Lock "cinder-quobyte-934eab9a-596a-4417-9404-7c9b5572cfda" acquired by "delete_volume" :: waited 0.027s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:03 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ff6205-f7e8-430b-9f79-b481460319f0]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9df9b63c-f323-49bb-8b20-9ef26be62ae9 tempest-VolumesMetadataTest-487109641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-934eab9a-596a-4417-9404-7c9b5572cfda {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:03 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-934eab9a-596a-4417-9404-7c9b5572cfda Jul 08 01:16:03 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:03 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-40cefd4e-162a-4609-8335-d010720ae859 tempest-VolumesExtendTest-323172794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f" returned: 0 in 1.293s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-40cefd4e-162a-4609-8335-d010720ae859 tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f.1a9998c9-489e-4d8d-af2e-7f4feb700411 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:03 devstack sudo[96824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f.1a9998c9-489e-4d8d-af2e-7f4feb700411 Jul 08 01:16:03 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:03 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7207891f-db3c-434a-9b05-46ccac83cc67" returned: 0 in 1.214s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:03 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-quobyte-7207891f-db3c-434a-9b05-46ccac83cc67" released by "_delete_snapshot" :: held 4.676s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:03 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-quobyte-258c64b2-4a45-4684-9ccb-0e9a4d438b95" released by "delete_snapshot" :: held 4.701s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:04 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Created reservations ['e46d61fd-3106-4dbd-9e1f-8577685bc797', 'b1571c76-0e13-43e0-9c9b-1dc2e6003883', '932e261d-5899-4431-88fd-ae303e6efbda', '2592dfc2-916b-4900-96e4-0e50cf5feeaf'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:16:04 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Delete snapshot completed successfully. Jul 08 01:16:04 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-7207891f-db3c-434a-9b05-46ccac83cc67-delete_snapshot" released by "delete_snapshot" :: held 5.001s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:04 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "cinder-7784b523-8263-4e11-a65a-6b8754605069-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:04 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-7784b523-8263-4e11-a65a-6b8754605069-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:04 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "cinder-quobyte-258c64b2-4a45-4684-9ccb-0e9a4d438b95" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:04 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-quobyte-258c64b2-4a45-4684-9ccb-0e9a4d438b95" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:04 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "cinder-quobyte-7784b523-8263-4e11-a65a-6b8754605069" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:04 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-quobyte-7784b523-8263-4e11-a65a-6b8754605069" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Deleting offline snapshot 7784b523-8263-4e11-a65a-6b8754605069 of volume 258c64b2-4a45-4684-9ccb-0e9a4d438b95 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:16:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] snapshot_file for this snap is: volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:16:04 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a3757f-48ae-4098-b233-7593ba02ac96]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:04 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9df9b63c-f323-49bb-8b20-9ef26be62ae9 tempest-VolumesMetadataTest-487109641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-934eab9a-596a-4417-9404-7c9b5572cfda" returned: 0 in 1.261s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9df9b63c-f323-49bb-8b20-9ef26be62ae9 tempest-VolumesMetadataTest-487109641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-934eab9a-596a-4417-9404-7c9b5572cfda {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:04 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-934eab9a-596a-4417-9404-7c9b5572cfda Jul 08 01:16:04 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:04 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069 Jul 08 01:16:04 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:04 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-40cefd4e-162a-4609-8335-d010720ae859 tempest-VolumesExtendTest-323172794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f.1a9998c9-489e-4d8d-af2e-7f4feb700411" returned: 0 in 1.203s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-40cefd4e-162a-4609-8335-d010720ae859 tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f.1a9998c9-489e-4d8d-af2e-7f4feb700411 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:04 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f.1a9998c9-489e-4d8d-af2e-7f4feb700411 Jul 08 01:16:04 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:05 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9df9b63c-f323-49bb-8b20-9ef26be62ae9 tempest-VolumesMetadataTest-487109641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-934eab9a-596a-4417-9404-7c9b5572cfda" returned: 0 in 0.827s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:05 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069" returned: 0 in 0.901s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:05 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:16:05 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-9df9b63c-f323-49bb-8b20-9ef26be62ae9 tempest-VolumesMetadataTest-487109641 None] Lock "cinder-quobyte-934eab9a-596a-4417-9404-7c9b5572cfda" released by "delete_volume" :: held 2.193s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:05 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bf859f-c345-4765-b02f-c77bb4c5be9a]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:05 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-9df9b63c-f323-49bb-8b20-9ef26be62ae9 tempest-VolumesMetadataTest-487109641 None] Created reservations ['bdcd9b2e-c92c-4f76-ac68-9decbb5faadf', '12f22e43-f1e7-4a1c-b97b-18fcde4fe7bd', 'a7c71816-918a-4851-b965-6811d1a895f1', 'b3ab30f8-0880-47b8-8f68-9a0968c7606c'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:16:05 devstack sudo[96846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95 Jul 08 01:16:05 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:05 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-40cefd4e-162a-4609-8335-d010720ae859 tempest-VolumesExtendTest-323172794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f.1a9998c9-489e-4d8d-af2e-7f4feb700411" returned: 0 in 0.862s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:05 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-40cefd4e-162a-4609-8335-d010720ae859 tempest-VolumesExtendTest-323172794 None] Lock "cinder-quobyte-1a9998c9-489e-4d8d-af2e-7f4feb700411" released by "_delete_snapshot" :: held 4.582s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:05 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-40cefd4e-162a-4609-8335-d010720ae859 tempest-VolumesExtendTest-323172794 None] Lock "cinder-quobyte-99b50d7a-0682-438f-b622-462d873ae18f" released by "delete_snapshot" :: held 4.624s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9df9b63c-f323-49bb-8b20-9ef26be62ae9 tempest-VolumesMetadataTest-487109641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9df9b63c-f323-49bb-8b20-9ef26be62ae9 tempest-VolumesMetadataTest-487109641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:05 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-9df9b63c-f323-49bb-8b20-9ef26be62ae9 tempest-VolumesMetadataTest-487109641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:16:05 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-9df9b63c-f323-49bb-8b20-9ef26be62ae9 tempest-VolumesMetadataTest-487109641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:16:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9df9b63c-f323-49bb-8b20-9ef26be62ae9 tempest-VolumesMetadataTest-487109641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9df9b63c-f323-49bb-8b20-9ef26be62ae9 tempest-VolumesMetadataTest-487109641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:05 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:16:05 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:05 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-40cefd4e-162a-4609-8335-d010720ae859 tempest-VolumesExtendTest-323172794 None] Created reservations ['e1d97e81-1379-4b98-b69f-894e2cf28500', '4a9e885b-9dfa-46dd-8e5d-36211c9bb7ac', 'a06a9a7f-1b66-446f-b195-699be8daa456', 'a07deafd-837e-4b5f-b998-da3ae460fe32'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:16:05 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-40cefd4e-162a-4609-8335-d010720ae859 tempest-VolumesExtendTest-323172794 None] Delete snapshot completed successfully. Jul 08 01:16:05 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-40cefd4e-162a-4609-8335-d010720ae859 tempest-VolumesExtendTest-323172794 None] Lock "cinder-1a9998c9-489e-4d8d-af2e-7f4feb700411-delete_snapshot" released by "delete_snapshot" :: held 4.866s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:06 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95" returned: 0 in 1.022s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:06 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9df9b63c-f323-49bb-8b20-9ef26be62ae9 tempest-VolumesMetadataTest-487109641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.764s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:06 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-9df9b63c-f323-49bb-8b20-9ef26be62ae9 tempest-VolumesMetadataTest-487109641 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:16:06 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-9df9b63c-f323-49bb-8b20-9ef26be62ae9 tempest-VolumesMetadataTest-487109641 None] Deleted volume successfully. Jul 08 01:16:06 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069 Jul 08 01:16:06 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:06 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4b6f7e09-10f7-4575-b1a8-ee7f9e34b4cd tempest-VolumesExtendTest-323172794 None] Acquiring lock "cinder-99b50d7a-0682-438f-b622-462d873ae18f-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:06 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-9df9b63c-f323-49bb-8b20-9ef26be62ae9 tempest-VolumesMetadataTest-487109641 None] Lock "cinder-934eab9a-596a-4417-9404-7c9b5572cfda-delete_volume" released by "delete_volume" :: held 3.429s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:06 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4b6f7e09-10f7-4575-b1a8-ee7f9e34b4cd tempest-VolumesExtendTest-323172794 None] Lock "cinder-99b50d7a-0682-438f-b622-462d873ae18f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:06 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4b6f7e09-10f7-4575-b1a8-ee7f9e34b4cd tempest-VolumesExtendTest-323172794 None] Acquiring lock "cinder-quobyte-99b50d7a-0682-438f-b622-462d873ae18f" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:06 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4b6f7e09-10f7-4575-b1a8-ee7f9e34b4cd tempest-VolumesExtendTest-323172794 None] Lock "cinder-quobyte-99b50d7a-0682-438f-b622-462d873ae18f" acquired by "delete_volume" :: waited 0.022s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:06 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f84c820-b26b-4b3b-a150-4de3c4c34ea5]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4b6f7e09-10f7-4575-b1a8-ee7f9e34b4cd tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:06 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f Jul 08 01:16:06 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:07 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069" returned: 0 in 1.290s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:07 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069 Jul 08 01:16:07 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:07 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4b6f7e09-10f7-4575-b1a8-ee7f9e34b4cd tempest-VolumesExtendTest-323172794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f" returned: 0 in 1.217s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4b6f7e09-10f7-4575-b1a8-ee7f9e34b4cd tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:07 devstack sudo[96905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f Jul 08 01:16:07 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:08 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95.7784b523-8263-4e11-a65a-6b8754605069" returned: 0 in 0.990s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-quobyte-7784b523-8263-4e11-a65a-6b8754605069" released by "_delete_snapshot" :: held 4.365s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:08 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4b6f7e09-10f7-4575-b1a8-ee7f9e34b4cd tempest-VolumesExtendTest-323172794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b50d7a-0682-438f-b622-462d873ae18f" returned: 0 in 0.909s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-quobyte-258c64b2-4a45-4684-9ccb-0e9a4d438b95" released by "delete_snapshot" :: held 4.414s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4b6f7e09-10f7-4575-b1a8-ee7f9e34b4cd tempest-VolumesExtendTest-323172794 None] Lock "cinder-quobyte-99b50d7a-0682-438f-b622-462d873ae18f" released by "delete_volume" :: held 2.211s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:08 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Created reservations ['57f302a7-9e20-413c-9b93-3aeabac2e28b', 'a37d9444-9045-43d7-abea-6459815ad035', 'b0ce8824-2173-4031-9a9f-993126abf9b8', '65e73b15-c703-4b8f-b4b9-24907b611010'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:16:08 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-4b6f7e09-10f7-4575-b1a8-ee7f9e34b4cd tempest-VolumesExtendTest-323172794 None] Created reservations ['307edd1a-e76d-467b-b3c9-bb33b7919fb5', '3af9e2e2-b03b-4088-a68a-1ee2415ee04e', '03d5593b-ce76-4ad8-98d4-94c013688ddd', 'a3a9a5c3-c980-4224-9fb4-118da1732f1a'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:16:08 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Delete snapshot completed successfully. Jul 08 01:16:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-7784b523-8263-4e11-a65a-6b8754605069-delete_snapshot" released by "delete_snapshot" :: held 4.717s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Snapshots deleted, issuing volume delete {{(pid=87022) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 01:16:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "cinder-quobyte-258c64b2-4a45-4684-9ccb-0e9a4d438b95" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-quobyte-258c64b2-4a45-4684-9ccb-0e9a4d438b95" acquired by "delete_volume" :: waited 0.034s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4b6f7e09-10f7-4575-b1a8-ee7f9e34b4cd tempest-VolumesExtendTest-323172794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4b6f7e09-10f7-4575-b1a8-ee7f9e34b4cd tempest-VolumesExtendTest-323172794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:08 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4b6f7e09-10f7-4575-b1a8-ee7f9e34b4cd tempest-VolumesExtendTest-323172794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:16:08 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4b6f7e09-10f7-4575-b1a8-ee7f9e34b4cd tempest-VolumesExtendTest-323172794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:16:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4b6f7e09-10f7-4575-b1a8-ee7f9e34b4cd tempest-VolumesExtendTest-323172794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4b6f7e09-10f7-4575-b1a8-ee7f9e34b4cd tempest-VolumesExtendTest-323172794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:09 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a0821a-8d23-4ac5-8baf-57e3ea61379b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:09 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:16:09 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:09 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95 Jul 08 01:16:09 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:10 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4b6f7e09-10f7-4575-b1a8-ee7f9e34b4cd tempest-VolumesExtendTest-323172794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.125s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:10 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-4b6f7e09-10f7-4575-b1a8-ee7f9e34b4cd tempest-VolumesExtendTest-323172794 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:16:10 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-4b6f7e09-10f7-4575-b1a8-ee7f9e34b4cd tempest-VolumesExtendTest-323172794 None] Deleted volume successfully. Jul 08 01:16:10 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4b6f7e09-10f7-4575-b1a8-ee7f9e34b4cd tempest-VolumesExtendTest-323172794 None] Lock "cinder-99b50d7a-0682-438f-b622-462d873ae18f-delete_volume" released by "delete_volume" :: held 3.809s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:10 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95" returned: 0 in 1.344s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:10 devstack sudo[96919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95 Jul 08 01:16:10 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:11 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-258c64b2-4a45-4684-9ccb-0e9a4d438b95" returned: 0 in 1.093s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:11 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-quobyte-258c64b2-4a45-4684-9ccb-0e9a4d438b95" released by "delete_volume" :: held 2.543s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:11 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Created reservations ['64508635-9a51-407a-a201-437b7600aa26', '90cdd30f-c8da-4a79-8d4a-90ecb2bb99de', 'b5072d7e-efb2-487b-9708-2c3be4b36b8c', 'e9334ab9-fee7-467b-a393-5e0a100ee758'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:16:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:11 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:16:11 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:16:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:11 devstack sudo[96922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:16:11 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:12 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.063s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:12 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:16:12 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Deleted volume successfully. Jul 08 01:16:12 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6d6ea1de-8564-486b-b9b2-859da63ada15 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-258c64b2-4a45-4684-9ccb-0e9a4d438b95-delete_volume" released by "delete_volume" :: held 13.882s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:13 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:16:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Flow 'volume_create_manager' (5eba6d97-98e8-4963-a7d4-8d495e66f2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:16:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a50c302-83e3-4ca8-8fdd-1c60ce715e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a50c302-83e3-4ca8-8fdd-1c60ce715e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-614859313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8fd02f1-d3c0-444f-8e71-d7de6a870a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614f7f74835947d59715a45908c14ee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:16:14Z,use_quota=True,user_id='8f38f8e55b114e53aef35d33b4fa5308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222e4fbd-71e2-47bb-8016-e8ef29d109a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222e4fbd-71e2-47bb-8016-e8ef29d109a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d7c4c96-1dbe-49fc-a899-03c4715910bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d7c4c96-1dbe-49fc-a899-03c4715910bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8fd02f1-d3c0-444f-8e71-d7de6a870a12', 'volume_name': 'volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf302fc-ec6f-4ed7-9637-3ddebeb78374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf302fc-ec6f-4ed7-9637-3ddebeb78374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (648f9524-9f50-447e-8eea-14d6c37980d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:14 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Volume e8fd02f1-d3c0-444f-8e71-d7de6a870a12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12', 'volume_size': 1} Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-614859313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8fd02f1-d3c0-444f-8e71-d7de6a870a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614f7f74835947d59715a45908c14ee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:16:14Z,use_quota=True,user_id='8f38f8e55b114e53aef35d33b4fa5308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Creating volume e8fd02f1-d3c0-444f-8e71-d7de6a870a12 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:16:14 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:14 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12 1073741824 Jul 08 01:16:14 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Flow 'volume_create_manager' (b50d9820-6056-4aff-a992-7e91fa750c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5024bc9-87de-4110-b81d-9c534888eeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5024bc9-87de-4110-b81d-9c534888eeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-29197131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a76043-09b0-449f-807f-48e81d3fc861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e258260f1c4f7ea60dcab2c0df68c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:16:14Z,use_quota=True,user_id='7295064b388845b68edcc70b422e8ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1742bfa-fe76-4fa5-a118-4d8a4aec2982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1742bfa-fe76-4fa5-a118-4d8a4aec2982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de8b527-973c-4626-a82d-6669de66ed05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de8b527-973c-4626-a82d-6669de66ed05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82a76043-09b0-449f-807f-48e81d3fc861', 'volume_name': 'volume-82a76043-09b0-449f-807f-48e81d3fc861', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76658f7-4c0f-4f5c-ad31-78fa13ee6943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76658f7-4c0f-4f5c-ad31-78fa13ee6943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87245dfa-83bf-428c-abf8-51b5ac0a30e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:14 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Volume 82a76043-09b0-449f-807f-48e81d3fc861: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82a76043-09b0-449f-807f-48e81d3fc861', 'volume_size': 1} Jul 08 01:16:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:15 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12 1073741824" returned: 0 in 1.072s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:15 devstack sudo[96973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12 Jul 08 01:16:15 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Flow 'volume_create_manager' (ada88636-145d-4f08-ad6d-2d61d9414810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b201ef-e6a1-4056-874b-3ec7948264ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b201ef-e6a1-4056-874b-3ec7948264ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-892838083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87086d5c-2e68-411b-b10d-97625d8830d5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ac54fcd394484815b85bd40e4fd6c64a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:16:16Z,use_quota=True,user_id='be79671ce36445a3a7abfb1c95648f1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f03906e8-f916-4a00-98ae-f29d994df937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f03906e8-f916-4a00-98ae-f29d994df937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbcddc47-2a9a-417d-8511-e76e02157259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbcddc47-2a9a-417d-8511-e76e02157259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87086d5c-2e68-411b-b10d-97625d8830d5', 'volume_name': 'volume-87086d5c-2e68-411b-b10d-97625d8830d5', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081a996b-cfc2-4c4f-a3fe-552e23920990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081a996b-cfc2-4c4f-a3fe-552e23920990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae98673d-b5c4-48f4-9398-e6e50c09be47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:15 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Volume 87086d5c-2e68-411b-b10d-97625d8830d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87086d5c-2e68-411b-b10d-97625d8830d5', 'volume_size': 1} Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:15 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12" returned: 0 in 0.717s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.539s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-29197131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a76043-09b0-449f-807f-48e81d3fc861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e258260f1c4f7ea60dcab2c0df68c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:16:14Z,use_quota=True,user_id='7295064b388845b68edcc70b422e8ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Creating volume 82a76043-09b0-449f-807f-48e81d3fc861 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:16:15 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-82a76043-09b0-449f-807f-48e81d3fc861 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:15 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-82a76043-09b0-449f-807f-48e81d3fc861 1073741824 Jul 08 01:16:15 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (648f9524-9f50-447e-8eea-14d6c37980d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b28d22-3b4d-47f3-aefd-1ec377c5477f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:15 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Volume volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12 (e8fd02f1-d3c0-444f-8e71-d7de6a870a12): created successfully Jul 08 01:16:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b28d22-3b4d-47f3-aefd-1ec377c5477f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Flow 'volume_create_manager' (5eba6d97-98e8-4963-a7d4-8d495e66f2bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:16:16 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-103a05d2-9cdb-4a65-b33a-13ec01454885 tempest-VolumesDeleteCascade-165698782 None] Created volume successfully. Jul 08 01:16:16 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-82a76043-09b0-449f-807f-48e81d3fc861 1073741824" returned: 0 in 0.910s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-82a76043-09b0-449f-807f-48e81d3fc861 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:16 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-82a76043-09b0-449f-807f-48e81d3fc861 Jul 08 01:16:16 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-cabc63bc-345e-4004-b559-75af8dd915ff tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:17 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-82a76043-09b0-449f-807f-48e81d3fc861" returned: 0 in 0.782s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:16:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.973s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-892838083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87086d5c-2e68-411b-b10d-97625d8830d5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ac54fcd394484815b85bd40e4fd6c64a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:16:16Z,use_quota=True,user_id='be79671ce36445a3a7abfb1c95648f1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:16:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Creating volume 87086d5c-2e68-411b-b10d-97625d8830d5 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:16:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:16:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:16:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:16:17 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:16:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-87086d5c-2e68-411b-b10d-97625d8830d5 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:17 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-87086d5c-2e68-411b-b10d-97625d8830d5 1073741824 Jul 08 01:16:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87245dfa-83bf-428c-abf8-51b5ac0a30e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a76043-09b0-449f-807f-48e81d3fc861', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:17 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae0b73f-4dd3-4880-b601-efa23e2d87fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:17 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Volume volume-82a76043-09b0-449f-807f-48e81d3fc861 (82a76043-09b0-449f-807f-48e81d3fc861): created successfully Jul 08 01:16:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae0b73f-4dd3-4880-b601-efa23e2d87fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Flow 'volume_create_manager' (b50d9820-6056-4aff-a992-7e91fa750c1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:16:17 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-596ae2dd-851d-4631-82e4-829b223beade tempest-VolumesTransfersTest-228445343 None] Created volume successfully. Jul 08 01:16:18 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-87086d5c-2e68-411b-b10d-97625d8830d5 1073741824" returned: 0 in 1.299s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-87086d5c-2e68-411b-b10d-97625d8830d5 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:19 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-87086d5c-2e68-411b-b10d-97625d8830d5 Jul 08 01:16:19 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:19 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-87282572-7041-47f0-8c62-013db4801fdc tempest-VolumesTransfersTest-928554568 None] Transfer volume completed successfully. Jul 08 01:16:19 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-87086d5c-2e68-411b-b10d-97625d8830d5" returned: 0 in 0.761s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] <== create_volume: return (2146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:16:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.149s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-cabc63bc-345e-4004-b559-75af8dd915ff tempest-VolumesDeleteCascade-165698782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.576s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-cabc63bc-345e-4004-b559-75af8dd915ff tempest-VolumesDeleteCascade-165698782 None] Creating offline snapshot 336dc15e-52bf-4da1-bd18-5c3e3f318ad7 of volume e8fd02f1-d3c0-444f-8e71-d7de6a870a12 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:16:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae98673d-b5c4-48f4-9398-e6e50c09be47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87086d5c-2e68-411b-b10d-97625d8830d5', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97817233-459c-428a-9613-d9d264c20c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:19 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[783404a6-b7e4-4a8b-9a14-f2c9a06a0295]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cabc63bc-345e-4004-b559-75af8dd915ff tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:19 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Volume volume-87086d5c-2e68-411b-b10d-97625d8830d5 (87086d5c-2e68-411b-b10d-97625d8830d5): created successfully Jul 08 01:16:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97817233-459c-428a-9613-d9d264c20c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Flow 'volume_create_manager' (ada88636-145d-4f08-ad6d-2d61d9414810) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:16:19 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-746344e1-4791-44a9-81d9-d7b90d074a5e tempest-VolumesGetTest-438911491 None] Created volume successfully. Jul 08 01:16:20 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12 Jul 08 01:16:20 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-44246c69-0331-42b2-81a0-af63809001fc tempest-VolumesTransfersTest-830794479 None] Acquiring lock "cinder-82a76043-09b0-449f-807f-48e81d3fc861-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-44246c69-0331-42b2-81a0-af63809001fc tempest-VolumesTransfersTest-830794479 None] Lock "cinder-82a76043-09b0-449f-807f-48e81d3fc861-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-44246c69-0331-42b2-81a0-af63809001fc tempest-VolumesTransfersTest-830794479 None] Acquiring lock "cinder-quobyte-82a76043-09b0-449f-807f-48e81d3fc861" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-44246c69-0331-42b2-81a0-af63809001fc tempest-VolumesTransfersTest-830794479 None] Lock "cinder-quobyte-82a76043-09b0-449f-807f-48e81d3fc861" acquired by "delete_volume" :: waited 0.016s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:20 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[9477ceba-a441-4565-9a57-a1d25dea5f0c]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-44246c69-0331-42b2-81a0-af63809001fc tempest-VolumesTransfersTest-830794479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-82a76043-09b0-449f-807f-48e81d3fc861 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:20 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cabc63bc-345e-4004-b559-75af8dd915ff tempest-VolumesDeleteCascade-165698782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12" returned: 0 in 0.932s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cabc63bc-345e-4004-b559-75af8dd915ff tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.336dc15e-52bf-4da1-bd18-5c3e3f318ad7 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:20 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-82a76043-09b0-449f-807f-48e81d3fc861 Jul 08 01:16:20 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:20 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.336dc15e-52bf-4da1-bd18-5c3e3f318ad7 1G Jul 08 01:16:20 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:21 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-44246c69-0331-42b2-81a0-af63809001fc tempest-VolumesTransfersTest-830794479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-82a76043-09b0-449f-807f-48e81d3fc861" returned: 0 in 1.167s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-44246c69-0331-42b2-81a0-af63809001fc tempest-VolumesTransfersTest-830794479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-82a76043-09b0-449f-807f-48e81d3fc861 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:21 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-82a76043-09b0-449f-807f-48e81d3fc861 Jul 08 01:16:21 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:22 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:16:22 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Flow 'volume_create_manager' (f2b77c57-1211-413b-bbf4-93ff69d0f4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:16:22 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38cf3755-fc00-4b35-9501-584160825393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:22 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38cf3755-fc00-4b35-9501-584160825393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:16:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1129128089',display_name='tempest-VolumesGetTest-Volume-2043567018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c08c3ce9-be92-40ef-a83b-bb0707fbfc7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac54fcd394484815b85bd40e4fd6c64a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:16:22Z,use_quota=True,user_id='be79671ce36445a3a7abfb1c95648f1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:22 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a76b132a-7a0d-43fa-adc8-7a060ba90b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:22 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a76b132a-7a0d-43fa-adc8-7a060ba90b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:22 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a27dcfc6-80c0-41b4-adf8-0d777f89c4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:22 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a27dcfc6-80c0-41b4-adf8-0d777f89c4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c08c3ce9-be92-40ef-a83b-bb0707fbfc7a', 'volume_name': 'volume-c08c3ce9-be92-40ef-a83b-bb0707fbfc7a', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:22 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ef57ce1-2eb5-49f8-a9c4-6b5366d787e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:22 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ef57ce1-2eb5-49f8-a9c4-6b5366d787e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:22 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c589aa-d067-4556-b832-fd10f08e963a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:22 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Volume c08c3ce9-be92-40ef-a83b-bb0707fbfc7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c08c3ce9-be92-40ef-a83b-bb0707fbfc7a', 'volume_size': 1} Jul 08 01:16:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:22 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cabc63bc-345e-4004-b559-75af8dd915ff tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.336dc15e-52bf-4da1-bd18-5c3e3f318ad7 1G" returned: 0 in 1.514s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cabc63bc-345e-4004-b559-75af8dd915ff tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.336dc15e-52bf-4da1-bd18-5c3e3f318ad7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:22 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.336dc15e-52bf-4da1-bd18-5c3e3f318ad7 Jul 08 01:16:22 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:22 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-44246c69-0331-42b2-81a0-af63809001fc tempest-VolumesTransfersTest-830794479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-82a76043-09b0-449f-807f-48e81d3fc861" returned: 0 in 1.037s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-44246c69-0331-42b2-81a0-af63809001fc tempest-VolumesTransfersTest-830794479 None] Lock "cinder-quobyte-82a76043-09b0-449f-807f-48e81d3fc861" released by "delete_volume" :: held 2.272s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:23 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-44246c69-0331-42b2-81a0-af63809001fc tempest-VolumesTransfersTest-830794479 None] Created reservations ['fb55b35e-cc8d-446d-9799-ceb49569ea56', 'c08567cf-e50c-4af0-940f-0d8b662dc83b', '39dc98d9-cce7-4846-91fb-70653018f62c', '186c8fca-bf0f-4d50-9ec5-80b7694263ee'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:16:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-44246c69-0331-42b2-81a0-af63809001fc tempest-VolumesTransfersTest-830794479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-44246c69-0331-42b2-81a0-af63809001fc tempest-VolumesTransfersTest-830794479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-44246c69-0331-42b2-81a0-af63809001fc tempest-VolumesTransfersTest-830794479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:16:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-44246c69-0331-42b2-81a0-af63809001fc tempest-VolumesTransfersTest-830794479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:16:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-44246c69-0331-42b2-81a0-af63809001fc tempest-VolumesTransfersTest-830794479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-44246c69-0331-42b2-81a0-af63809001fc tempest-VolumesTransfersTest-830794479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:23 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:16:23 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:23 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cabc63bc-345e-4004-b559-75af8dd915ff tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.336dc15e-52bf-4da1-bd18-5c3e3f318ad7" returned: 0 in 0.939s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:23 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-cabc63bc-345e-4004-b559-75af8dd915ff tempest-VolumesDeleteCascade-165698782 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.336dc15e-52bf-4da1-bd18-5c3e3f318ad7 is being set with open permissions: ugo+rw Jul 08 01:16:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cabc63bc-345e-4004-b559-75af8dd915ff tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.336dc15e-52bf-4da1-bd18-5c3e3f318ad7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:23 devstack sudo[97090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.336dc15e-52bf-4da1-bd18-5c3e3f318ad7 Jul 08 01:16:23 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:24 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-44246c69-0331-42b2-81a0-af63809001fc tempest-VolumesTransfersTest-830794479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.874s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:24 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-44246c69-0331-42b2-81a0-af63809001fc tempest-VolumesTransfersTest-830794479 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:16:24 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-44246c69-0331-42b2-81a0-af63809001fc tempest-VolumesTransfersTest-830794479 None] Deleted volume successfully. Jul 08 01:16:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-44246c69-0331-42b2-81a0-af63809001fc tempest-VolumesTransfersTest-830794479 None] Lock "cinder-82a76043-09b0-449f-807f-48e81d3fc861-delete_volume" released by "delete_volume" :: held 3.535s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:24 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cabc63bc-345e-4004-b559-75af8dd915ff tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.336dc15e-52bf-4da1-bd18-5c3e3f318ad7" returned: 0 in 0.964s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cabc63bc-345e-4004-b559-75af8dd915ff tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:24 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.info Jul 08 01:16:24 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Flow 'volume_create_manager' (6d81008f-d013-4a46-84a2-8b9bb813532d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29444ca5-8704-4595-9d1e-df91b9ea2b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29444ca5-8704-4595-9d1e-df91b9ea2b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-55504522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77d970499aee4d4eb5527d56ddfc9b56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:16:25Z,use_quota=True,user_id='37aa45cfd0cf48208550ae96241a3230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e584633-144b-4a6e-8377-7c8daac13e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e584633-144b-4a6e-8377-7c8daac13e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a302b487-c976-4d6c-8873-efa34733563a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a302b487-c976-4d6c-8873-efa34733563a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9', 'volume_name': 'volume-1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7989e8b4-3e84-4a11-ab1e-6ca23bd18b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7989e8b4-3e84-4a11-ab1e-6ca23bd18b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (331d9fb1-4307-4f19-b518-5abc6ea10465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:25 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Volume 1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9', 'volume_size': 1} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:25 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cabc63bc-345e-4004-b559-75af8dd915ff tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.info" returned: 0 in 0.870s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:25 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-cabc63bc-345e-4004-b559-75af8dd915ff tempest-VolumesDeleteCascade-165698782 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.info is being set with open permissions: ugo+rw Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cabc63bc-345e-4004-b559-75af8dd915ff tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Flow 'volume_create_manager' (4e70e812-9614-431d-af0a-23acd93587de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:16:25 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.info Jul 08 01:16:25 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c8bec33-f90e-4541-8b77-34d7d576eeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c8bec33-f90e-4541-8b77-34d7d576eeb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-199161899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419e5423-7770-4eba-a65a-a869c75a28cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e258260f1c4f7ea60dcab2c0df68c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:16:25Z,use_quota=True,user_id='7295064b388845b68edcc70b422e8ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9f3d7a8-821f-4938-a797-32d69ff1701e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9f3d7a8-821f-4938-a797-32d69ff1701e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f95936f4-d5e6-4359-99bb-7c94219a1269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f95936f4-d5e6-4359-99bb-7c94219a1269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '419e5423-7770-4eba-a65a-a869c75a28cb', 'volume_name': 'volume-419e5423-7770-4eba-a65a-a869c75a28cb', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44850d1b-457e-453e-899f-d4dd2daf6cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44850d1b-457e-453e-899f-d4dd2daf6cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (901dd06b-fd75-4c69-9470-c613468102e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:25 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Volume 419e5423-7770-4eba-a65a-a869c75a28cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-419e5423-7770-4eba-a65a-a869c75a28cb', 'volume_size': 1} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:25 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cabc63bc-345e-4004-b559-75af8dd915ff tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.info" returned: 0 in 0.727s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-cabc63bc-345e-4004-b559-75af8dd915ff tempest-VolumesDeleteCascade-165698782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.090s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.706s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:16:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1129128089',display_name='tempest-VolumesGetTest-Volume-2043567018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c08c3ce9-be92-40ef-a83b-bb0707fbfc7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac54fcd394484815b85bd40e4fd6c64a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:16:22Z,use_quota=True,user_id='be79671ce36445a3a7abfb1c95648f1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Creating volume c08c3ce9-be92-40ef-a83b-bb0707fbfc7a {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:16:25 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:16:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c08c3ce9-be92-40ef-a83b-bb0707fbfc7a 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:25 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c08c3ce9-be92-40ef-a83b-bb0707fbfc7a 1073741824 Jul 08 01:16:25 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:25 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-cabc63bc-345e-4004-b559-75af8dd915ff tempest-VolumesDeleteCascade-165698782 None] Create snapshot completed successfully Jul 08 01:16:26 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c08c3ce9-be92-40ef-a83b-bb0707fbfc7a 1073741824" returned: 0 in 0.886s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c08c3ce9-be92-40ef-a83b-bb0707fbfc7a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:26 devstack sudo[97105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c08c3ce9-be92-40ef-a83b-bb0707fbfc7a Jul 08 01:16:26 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:27 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:16:27 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Flow 'volume_create_manager' (66b4646a-4125-40f9-b851-951a35fb9573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:16:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e79f5a5-146c-478c-9965-5e7605851a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c08c3ce9-be92-40ef-a83b-bb0707fbfc7a" returned: 0 in 0.727s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:16:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.460s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-55504522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77d970499aee4d4eb5527d56ddfc9b56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:16:25Z,use_quota=True,user_id='37aa45cfd0cf48208550ae96241a3230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:16:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Creating volume 1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:16:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:16:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:16:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:16:27 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:16:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e79f5a5-146c-478c-9965-5e7605851a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-934565995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7043e87e-eba8-468e-b0d3-75d772073d80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614f7f74835947d59715a45908c14ee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=336dc15e-52bf-4da1-bd18-5c3e3f318ad7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:16:27Z,use_quota=True,user_id='8f38f8e55b114e53aef35d33b4fa5308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:27 devstack sudo[97109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9 1073741824 Jul 08 01:16:27 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a16f8a-68e9-4f4f-b9de-97e0a74daea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a16f8a-68e9-4f4f-b9de-97e0a74daea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed52b54d-f296-4563-945a-9b06753b20cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed52b54d-f296-4563-945a-9b06753b20cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7043e87e-eba8-468e-b0d3-75d772073d80', 'volume_name': 'volume-7043e87e-eba8-468e-b0d3-75d772073d80', 'volume_size': 1, 'snapshot_id': '336dc15e-52bf-4da1-bd18-5c3e3f318ad7'}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (862b3fe1-b486-422e-ba7e-bf6b0a00bee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (862b3fe1-b486-422e-ba7e-bf6b0a00bee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7d7574-d0c4-4715-aff8-63045f26b5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:27 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Volume 7043e87e-eba8-468e-b0d3-75d772073d80: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7043e87e-eba8-468e-b0d3-75d772073d80', 'volume_size': 1, 'snapshot_id': '336dc15e-52bf-4da1-bd18-5c3e3f318ad7'} Jul 08 01:16:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c589aa-d067-4556-b832-fd10f08e963a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c08c3ce9-be92-40ef-a83b-bb0707fbfc7a', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b576899d-e7a4-4141-9afb-0c5055462468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:27 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Volume volume-c08c3ce9-be92-40ef-a83b-bb0707fbfc7a (c08c3ce9-be92-40ef-a83b-bb0707fbfc7a): created successfully Jul 08 01:16:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b576899d-e7a4-4141-9afb-0c5055462468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Flow 'volume_create_manager' (f2b77c57-1211-413b-bbf4-93ff69d0f4ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:16:27 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-681d8032-6059-4aba-85f2-c2a2cb81ad5b tempest-VolumesGetTest-438911491 None] Created volume successfully. Jul 08 01:16:28 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9 1073741824" returned: 0 in 0.836s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:28 devstack sudo[97114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9 Jul 08 01:16:28 devstack sudo[97114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-181baf23-5c45-480c-a157-431cffc98c27 tempest-VolumesGetTest-438911491 None] Acquiring lock "cinder-c08c3ce9-be92-40ef-a83b-bb0707fbfc7a-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-181baf23-5c45-480c-a157-431cffc98c27 tempest-VolumesGetTest-438911491 None] Lock "cinder-c08c3ce9-be92-40ef-a83b-bb0707fbfc7a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:28 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:DELETE=11,cinder:SELECT=92,cinder:UPDATE=101,cinder:INSERT=29 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:16:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-181baf23-5c45-480c-a157-431cffc98c27 tempest-VolumesGetTest-438911491 None] Acquiring lock "cinder-quobyte-c08c3ce9-be92-40ef-a83b-bb0707fbfc7a" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-181baf23-5c45-480c-a157-431cffc98c27 tempest-VolumesGetTest-438911491 None] Lock "cinder-quobyte-c08c3ce9-be92-40ef-a83b-bb0707fbfc7a" acquired by "delete_volume" :: waited 0.030s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:28 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d040dbb-4683-4c2e-9ac0-5650795cd897]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-181baf23-5c45-480c-a157-431cffc98c27 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c08c3ce9-be92-40ef-a83b-bb0707fbfc7a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:29 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c08c3ce9-be92-40ef-a83b-bb0707fbfc7a Jul 08 01:16:29 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:29 devstack sudo[97114]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9" returned: 0 in 0.796s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:16:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.011s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-199161899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419e5423-7770-4eba-a65a-a869c75a28cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e258260f1c4f7ea60dcab2c0df68c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:16:25Z,use_quota=True,user_id='7295064b388845b68edcc70b422e8ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:16:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Creating volume 419e5423-7770-4eba-a65a-a869c75a28cb {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:16:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:16:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:16:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:16:29 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:16:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-419e5423-7770-4eba-a65a-a869c75a28cb 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:29 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-419e5423-7770-4eba-a65a-a869c75a28cb 1073741824 Jul 08 01:16:29 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (331d9fb1-4307-4f19-b518-5abc6ea10465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a4eb04d-ecbf-47ff-a0be-440b404a0bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:29 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Volume volume-1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9 (1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9): created successfully Jul 08 01:16:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a4eb04d-ecbf-47ff-a0be-440b404a0bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Flow 'volume_create_manager' (6d81008f-d013-4a46-84a2-8b9bb813532d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:16:29 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-bedaa16a-6db7-4156-ba97-b85f068488a8 tempest-TestMinimumBasicScenario-1357285902 None] Created volume successfully. Jul 08 01:16:29 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-181baf23-5c45-480c-a157-431cffc98c27 tempest-VolumesGetTest-438911491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c08c3ce9-be92-40ef-a83b-bb0707fbfc7a" returned: 0 in 0.877s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-181baf23-5c45-480c-a157-431cffc98c27 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c08c3ce9-be92-40ef-a83b-bb0707fbfc7a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:29 devstack sudo[97124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c08c3ce9-be92-40ef-a83b-bb0707fbfc7a Jul 08 01:16:29 devstack sudo[97124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:30 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-419e5423-7770-4eba-a65a-a869c75a28cb 1073741824" returned: 0 in 1.167s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-419e5423-7770-4eba-a65a-a869c75a28cb {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:30 devstack sudo[97132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-419e5423-7770-4eba-a65a-a869c75a28cb Jul 08 01:16:30 devstack sudo[97132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:30 devstack sudo[97124]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-181baf23-5c45-480c-a157-431cffc98c27 tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c08c3ce9-be92-40ef-a83b-bb0707fbfc7a" returned: 0 in 0.837s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:30 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-181baf23-5c45-480c-a157-431cffc98c27 tempest-VolumesGetTest-438911491 None] Lock "cinder-quobyte-c08c3ce9-be92-40ef-a83b-bb0707fbfc7a" released by "delete_volume" :: held 1.787s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:30 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-181baf23-5c45-480c-a157-431cffc98c27 tempest-VolumesGetTest-438911491 None] Created reservations ['1b7c7a56-7e40-4f84-b182-e6bb574553aa', 'ab746c05-dc73-4179-bb64-31429c43e6fe', '7820df48-b9cd-42bb-96ea-b45782f1f31f', '48cb4c5e-51c3-4bfb-a7eb-b0f9ef407612'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:16:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-181baf23-5c45-480c-a157-431cffc98c27 tempest-VolumesGetTest-438911491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-181baf23-5c45-480c-a157-431cffc98c27 tempest-VolumesGetTest-438911491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:30 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-181baf23-5c45-480c-a157-431cffc98c27 tempest-VolumesGetTest-438911491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:16:30 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-181baf23-5c45-480c-a157-431cffc98c27 tempest-VolumesGetTest-438911491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:16:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-181baf23-5c45-480c-a157-431cffc98c27 tempest-VolumesGetTest-438911491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-181baf23-5c45-480c-a157-431cffc98c27 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:30 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:16:30 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-253fdcd1-cec0-4610-aebb-8c3e5182979c tempest-VolumesGetTest-438911491 None] Acquiring lock "cinder-87086d5c-2e68-411b-b10d-97625d8830d5-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-253fdcd1-cec0-4610-aebb-8c3e5182979c tempest-VolumesGetTest-438911491 None] Lock "cinder-87086d5c-2e68-411b-b10d-97625d8830d5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-253fdcd1-cec0-4610-aebb-8c3e5182979c tempest-VolumesGetTest-438911491 None] Acquiring lock "cinder-quobyte-87086d5c-2e68-411b-b10d-97625d8830d5" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-253fdcd1-cec0-4610-aebb-8c3e5182979c tempest-VolumesGetTest-438911491 None] Lock "cinder-quobyte-87086d5c-2e68-411b-b10d-97625d8830d5" acquired by "delete_volume" :: waited 0.037s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:31 devstack sudo[97132]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-419e5423-7770-4eba-a65a-a869c75a28cb" returned: 0 in 0.803s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] <== create_volume: return (2033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.043s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.657s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "cinder-quobyte-336dc15e-52bf-4da1-bd18-5c3e3f318ad7-7043e87e-eba8-468e-b0d3-75d772073d80" by "_create_volume_from_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcf62cb-7547-4735-9936-5fd876e64f8d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-253fdcd1-cec0-4610-aebb-8c3e5182979c tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-87086d5c-2e68-411b-b10d-97625d8830d5 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (901dd06b-fd75-4c69-9470-c613468102e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-419e5423-7770-4eba-a65a-a869c75a28cb', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b4c8deb-a639-4407-8a53-19219ae16242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-quobyte-336dc15e-52bf-4da1-bd18-5c3e3f318ad7-7043e87e-eba8-468e-b0d3-75d772073d80" acquired by "_create_volume_from_snapshot" :: waited 0.055s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Creating volume 7043e87e-eba8-468e-b0d3-75d772073d80 from snapshot 336dc15e-52bf-4da1-bd18-5c3e3f318ad7 {{(pid=87022) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "cinder-quobyte-7043e87e-eba8-468e-b0d3-75d772073d80" by "_copy_volume_from_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:31 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Volume volume-419e5423-7770-4eba-a65a-a869c75a28cb (419e5423-7770-4eba-a65a-a869c75a28cb): created successfully Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b4c8deb-a639-4407-8a53-19219ae16242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Flow 'volume_create_manager' (4e70e812-9614-431d-af0a-23acd93587de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-quobyte-7043e87e-eba8-468e-b0d3-75d772073d80" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] snapshot: 336dc15e-52bf-4da1-bd18-5c3e3f318ad7, volume: 7043e87e-eba8-468e-b0d3-75d772073d80, {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:16:31 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-33530cc9-ce61-4976-988b-035a15734446 tempest-VolumesTransfersTest-228445343 None] Created volume successfully. Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bca7d0d-f28b-488b-b48a-e36102f2baa3]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.336dc15e-52bf-4da1-bd18-5c3e3f318ad7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:31 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-87086d5c-2e68-411b-b10d-97625d8830d5 Jul 08 01:16:31 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:31 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.336dc15e-52bf-4da1-bd18-5c3e3f318ad7 Jul 08 01:16:31 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:31 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-181baf23-5c45-480c-a157-431cffc98c27 tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.961s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-181baf23-5c45-480c-a157-431cffc98c27 tempest-VolumesGetTest-438911491 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:16:31 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-181baf23-5c45-480c-a157-431cffc98c27 tempest-VolumesGetTest-438911491 None] Deleted volume successfully. Jul 08 01:16:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-181baf23-5c45-480c-a157-431cffc98c27 tempest-VolumesGetTest-438911491 None] Lock "cinder-c08c3ce9-be92-40ef-a83b-bb0707fbfc7a-delete_volume" released by "delete_volume" :: held 3.068s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:32 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-253fdcd1-cec0-4610-aebb-8c3e5182979c tempest-VolumesGetTest-438911491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-87086d5c-2e68-411b-b10d-97625d8830d5" returned: 0 in 0.933s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-253fdcd1-cec0-4610-aebb-8c3e5182979c tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-87086d5c-2e68-411b-b10d-97625d8830d5 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:32 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-87086d5c-2e68-411b-b10d-97625d8830d5 Jul 08 01:16:32 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:32 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.336dc15e-52bf-4da1-bd18-5c3e3f318ad7" returned: 0 in 0.995s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:32 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:16:32 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] will copy from snapshot at /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12 {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:16:32 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Creating direct copy from snapshot {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:16:32 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[6055e5fe-8193-4a18-83f8-45bbf7989335]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:32 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12 Jul 08 01:16:32 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-12d9e8c4-22da-498a-849b-3a3b0ad49de5 tempest-VolumesTransfersTest-830794479 None] Acquiring lock "cinder-419e5423-7770-4eba-a65a-a869c75a28cb-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-12d9e8c4-22da-498a-849b-3a3b0ad49de5 tempest-VolumesTransfersTest-830794479 None] Lock "cinder-419e5423-7770-4eba-a65a-a869c75a28cb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-12d9e8c4-22da-498a-849b-3a3b0ad49de5 tempest-VolumesTransfersTest-830794479 None] Acquiring lock "cinder-quobyte-419e5423-7770-4eba-a65a-a869c75a28cb" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-12d9e8c4-22da-498a-849b-3a3b0ad49de5 tempest-VolumesTransfersTest-830794479 None] Lock "cinder-quobyte-419e5423-7770-4eba-a65a-a869c75a28cb" acquired by "delete_volume" :: waited 0.026s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:33 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bddd71e-de47-4f88-969f-a55f74a4de1b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-12d9e8c4-22da-498a-849b-3a3b0ad49de5 tempest-VolumesTransfersTest-830794479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-419e5423-7770-4eba-a65a-a869c75a28cb {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:33 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-253fdcd1-cec0-4610-aebb-8c3e5182979c tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-87086d5c-2e68-411b-b10d-97625d8830d5" returned: 0 in 1.066s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-253fdcd1-cec0-4610-aebb-8c3e5182979c tempest-VolumesGetTest-438911491 None] Lock "cinder-quobyte-87086d5c-2e68-411b-b10d-97625d8830d5" released by "delete_volume" :: held 2.059s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:33 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-253fdcd1-cec0-4610-aebb-8c3e5182979c tempest-VolumesGetTest-438911491 None] Created reservations ['ad1f6f4c-c79e-4484-89f3-e7c5da5742b2', 'e7d22a73-0dc0-449c-8219-7f3ea1d9266d', '46b73287-720e-47be-951f-fa8a52c89044', '75a0f053-b17a-4e85-aa96-ab70f20158b5'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:16:33 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-419e5423-7770-4eba-a65a-a869c75a28cb Jul 08 01:16:33 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-253fdcd1-cec0-4610-aebb-8c3e5182979c tempest-VolumesGetTest-438911491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-253fdcd1-cec0-4610-aebb-8c3e5182979c tempest-VolumesGetTest-438911491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:33 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-253fdcd1-cec0-4610-aebb-8c3e5182979c tempest-VolumesGetTest-438911491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:16:33 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-253fdcd1-cec0-4610-aebb-8c3e5182979c tempest-VolumesGetTest-438911491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:16:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-253fdcd1-cec0-4610-aebb-8c3e5182979c tempest-VolumesGetTest-438911491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-253fdcd1-cec0-4610-aebb-8c3e5182979c tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:33 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:16:33 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:33 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12" returned: 0 in 1.412s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:33 devstack cinder-volume[87022]: DEBUG cinder.utils [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Path /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7043e87e-eba8-468e-b0d3-75d772073d80 not found in is_blk_device check {{(pid=87022) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:16:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7043e87e-eba8-468e-b0d3-75d772073d80 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:34 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7043e87e-eba8-468e-b0d3-75d772073d80 Jul 08 01:16:34 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-987c92bb-a378-4d6e-a405-0b06b15795f7 req-9defceb9-1b4b-414f-b3fa-1b9c1763735e tempest-TestMinimumBasicScenario-1357285902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:34 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-253fdcd1-cec0-4610-aebb-8c3e5182979c tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.958s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:34 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-253fdcd1-cec0-4610-aebb-8c3e5182979c tempest-VolumesGetTest-438911491 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:16:34 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:34 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-253fdcd1-cec0-4610-aebb-8c3e5182979c tempest-VolumesGetTest-438911491 None] Deleted volume successfully. Jul 08 01:16:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-12d9e8c4-22da-498a-849b-3a3b0ad49de5 tempest-VolumesTransfersTest-830794479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-419e5423-7770-4eba-a65a-a869c75a28cb" returned: 0 in 1.311s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-12d9e8c4-22da-498a-849b-3a3b0ad49de5 tempest-VolumesTransfersTest-830794479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-419e5423-7770-4eba-a65a-a869c75a28cb {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:34 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-253fdcd1-cec0-4610-aebb-8c3e5182979c tempest-VolumesGetTest-438911491 None] Lock "cinder-87086d5c-2e68-411b-b10d-97625d8830d5-delete_volume" released by "delete_volume" :: held 3.491s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:34 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-419e5423-7770-4eba-a65a-a869c75a28cb Jul 08 01:16:34 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:35 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:16:35 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Flow 'volume_create_manager' (39ab23b3-95e7-47ac-91a4-812cefc07234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:16:35 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f151cfb6-3893-475f-82cf-f604515e15e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:35 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f151cfb6-3893-475f-82cf-f604515e15e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-626343279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99b6fd94-7a69-42d2-a375-cb4d1c6b7914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac54fcd394484815b85bd40e4fd6c64a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:16:35Z,use_quota=True,user_id='be79671ce36445a3a7abfb1c95648f1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:35 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00fa0fbc-1197-4e2d-b290-3ddacc7d305b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:35 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00fa0fbc-1197-4e2d-b290-3ddacc7d305b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:35 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ec161f-4127-4ef1-a5e1-d031cbb9a2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:35 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ec161f-4127-4ef1-a5e1-d031cbb9a2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99b6fd94-7a69-42d2-a375-cb4d1c6b7914', 'volume_name': 'volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:35 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95e2126c-8306-4623-9319-808976000a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:35 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95e2126c-8306-4623-9319-808976000a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:35 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a5936a-58b2-44dd-9e6f-b04831a30867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:35 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Volume 99b6fd94-7a69-42d2-a375-cb4d1c6b7914: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914', 'volume_size': 1} Jul 08 01:16:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:35 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-12d9e8c4-22da-498a-849b-3a3b0ad49de5 tempest-VolumesTransfersTest-830794479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-419e5423-7770-4eba-a65a-a869c75a28cb" returned: 0 in 0.938s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-12d9e8c4-22da-498a-849b-3a3b0ad49de5 tempest-VolumesTransfersTest-830794479 None] Lock "cinder-quobyte-419e5423-7770-4eba-a65a-a869c75a28cb" released by "delete_volume" :: held 2.318s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:35 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-12d9e8c4-22da-498a-849b-3a3b0ad49de5 tempest-VolumesTransfersTest-830794479 None] Created reservations ['119a8738-ab03-4a91-b241-521d4b9cfae0', 'eacc5be1-9120-4657-b274-ec825d61ec4d', '898be46c-4bb8-429a-930b-4212b2363442', '74def6ee-06a4-41a4-b2f2-05ef3a414a6e'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:16:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-12d9e8c4-22da-498a-849b-3a3b0ad49de5 tempest-VolumesTransfersTest-830794479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-12d9e8c4-22da-498a-849b-3a3b0ad49de5 tempest-VolumesTransfersTest-830794479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:35 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-12d9e8c4-22da-498a-849b-3a3b0ad49de5 tempest-VolumesTransfersTest-830794479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:16:35 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-12d9e8c4-22da-498a-849b-3a3b0ad49de5 tempest-VolumesTransfersTest-830794479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:16:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-12d9e8c4-22da-498a-849b-3a3b0ad49de5 tempest-VolumesTransfersTest-830794479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-12d9e8c4-22da-498a-849b-3a3b0ad49de5 tempest-VolumesTransfersTest-830794479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:35 devstack sudo[97220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:16:35 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:37 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-12d9e8c4-22da-498a-849b-3a3b0ad49de5 tempest-VolumesTransfersTest-830794479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.620s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:37 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-12d9e8c4-22da-498a-849b-3a3b0ad49de5 tempest-VolumesTransfersTest-830794479 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:16:37 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-12d9e8c4-22da-498a-849b-3a3b0ad49de5 tempest-VolumesTransfersTest-830794479 None] Deleted volume successfully. Jul 08 01:16:37 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-12d9e8c4-22da-498a-849b-3a3b0ad49de5 tempest-VolumesTransfersTest-830794479 None] Lock "cinder-419e5423-7770-4eba-a65a-a869c75a28cb-delete_volume" released by "delete_volume" :: held 4.326s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:39 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7043e87e-eba8-468e-b0d3-75d772073d80" returned: 0 in 5.908s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:39 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9947a3b-49fc-40a5-9f07-f62117e518f1]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:40 devstack sudo[97225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12 Jul 08 01:16:40 devstack sudo[97225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:40 devstack sudo[97225]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12" returned: 0 in 1.021s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:40 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Image conversion details: src /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12, size 1024.00 MB, duration 5.91 sec, destination /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7043e87e-eba8-468e-b0d3-75d772073d80 {{(pid=87022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:16:40 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Converted 1024.00 MB image at 173.28 MB/s Jul 08 01:16:40 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7043e87e-eba8-468e-b0d3-75d772073d80 is being set with open permissions: ugo+rw Jul 08 01:16:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7043e87e-eba8-468e-b0d3-75d772073d80 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:40 devstack sudo[97231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7043e87e-eba8-468e-b0d3-75d772073d80 Jul 08 01:16:40 devstack sudo[97231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:41 devstack sudo[97231]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7043e87e-eba8-468e-b0d3-75d772073d80" returned: 0 in 0.744s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:41 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-quobyte-7043e87e-eba8-468e-b0d3-75d772073d80" released by "_copy_volume_from_snapshot" :: held 10.245s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:41 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-quobyte-336dc15e-52bf-4da1-bd18-5c3e3f318ad7-7043e87e-eba8-468e-b0d3-75d772073d80" released by "_create_volume_from_snapshot" :: held 10.307s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.364s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-987c92bb-a378-4d6e-a405-0b06b15795f7 req-9defceb9-1b4b-414f-b3fa-1b9c1763735e tempest-TestMinimumBasicScenario-1357285902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.649s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:41 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac873fe3-ba91-4108-8135-429e811d82d8]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-987c92bb-a378-4d6e-a405-0b06b15795f7 req-9defceb9-1b4b-414f-b3fa-1b9c1763735e tempest-TestMinimumBasicScenario-1357285902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:41 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7d7574-d0c4-4715-aff8-63045f26b5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7043e87e-eba8-468e-b0d3-75d772073d80', 'volume_size': 1, 'snapshot_id': '336dc15e-52bf-4da1-bd18-5c3e3f318ad7'}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:41 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b6f023b-f33f-4ede-bb16-228d846ae2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:41 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Volume volume-7043e87e-eba8-468e-b0d3-75d772073d80 (7043e87e-eba8-468e-b0d3-75d772073d80): created successfully Jul 08 01:16:41 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b6f023b-f33f-4ede-bb16-228d846ae2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:41 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Flow 'volume_create_manager' (66b4646a-4125-40f9-b851-951a35fb9573) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:16:41 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-3fedde66-2643-48db-995e-cd8f8040603b tempest-VolumesDeleteCascade-165698782 None] Created volume successfully. Jul 08 01:16:41 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9 Jul 08 01:16:41 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "cinder-e8fd02f1-d3c0-444f-8e71-d7de6a870a12-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-e8fd02f1-d3c0-444f-8e71-d7de6a870a12-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Performing cascade delete. {{(pid=87022) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 01:16:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "cinder-336dc15e-52bf-4da1-bd18-5c3e3f318ad7-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-336dc15e-52bf-4da1-bd18-5c3e3f318ad7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "cinder-quobyte-e8fd02f1-d3c0-444f-8e71-d7de6a870a12" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-quobyte-e8fd02f1-d3c0-444f-8e71-d7de6a870a12" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "cinder-quobyte-336dc15e-52bf-4da1-bd18-5c3e3f318ad7" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-quobyte-336dc15e-52bf-4da1-bd18-5c3e3f318ad7" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:42 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Deleting offline snapshot 336dc15e-52bf-4da1-bd18-5c3e3f318ad7 of volume e8fd02f1-d3c0-444f-8e71-d7de6a870a12 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:16:42 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] snapshot_file for this snap is: volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.336dc15e-52bf-4da1-bd18-5c3e3f318ad7 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:16:42 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2ab2f4-f6c8-439a-8124-661169258de6]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.336dc15e-52bf-4da1-bd18-5c3e3f318ad7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:42 devstack sudo[97236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.336dc15e-52bf-4da1-bd18-5c3e3f318ad7 Jul 08 01:16:42 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:42 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-987c92bb-a378-4d6e-a405-0b06b15795f7 req-9defceb9-1b4b-414f-b3fa-1b9c1763735e tempest-TestMinimumBasicScenario-1357285902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9" returned: 0 in 1.113s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-987c92bb-a378-4d6e-a405-0b06b15795f7 req-9defceb9-1b4b-414f-b3fa-1b9c1763735e tempest-TestMinimumBasicScenario-1357285902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.147s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.359s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:42 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-626343279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99b6fd94-7a69-42d2-a375-cb4d1c6b7914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac54fcd394484815b85bd40e4fd6c64a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:16:35Z,use_quota=True,user_id='be79671ce36445a3a7abfb1c95648f1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:16:42 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Creating volume 99b6fd94-7a69-42d2-a375-cb4d1c6b7914 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:16:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:42 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:16:42 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:16:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:42 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:16:42 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:16:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:42 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914 1073741824 Jul 08 01:16:42 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-987c92bb-a378-4d6e-a405-0b06b15795f7 req-9defceb9-1b4b-414f-b3fa-1b9c1763735e tempest-TestMinimumBasicScenario-1357285902 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d', 'name': 'volume-1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '44698c94-cbe1-4e6c-b3a6-d8120d94457e', 'enforce_multipath': True} {{(pid=87022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:16:43 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-987c92bb-a378-4d6e-a405-0b06b15795f7 req-9defceb9-1b4b-414f-b3fa-1b9c1763735e tempest-TestMinimumBasicScenario-1357285902 None] attachment_update completed successfully. Jul 08 01:16:44 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.336dc15e-52bf-4da1-bd18-5c3e3f318ad7" returned: 0 in 1.503s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:16:44 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[567baa78-cb65-4ff5-a4bb-d7279794cdf3]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:44 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914 1073741824" returned: 0 in 1.354s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:44 devstack sudo[97318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12 Jul 08 01:16:44 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:44 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914 Jul 08 01:16:44 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:45 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12" returned: 0 in 0.955s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.336dc15e-52bf-4da1-bd18-5c3e3f318ad7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:45 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914" returned: 0 in 0.819s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] <== create_volume: return (2251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:16:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.257s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:45 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.336dc15e-52bf-4da1-bd18-5c3e3f318ad7 Jul 08 01:16:45 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a5936a-58b2-44dd-9e6f-b04831a30867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e3c1476-110f-4a22-bd88-52eb34391571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:45 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Volume volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914 (99b6fd94-7a69-42d2-a375-cb4d1c6b7914): created successfully Jul 08 01:16:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e3c1476-110f-4a22-bd88-52eb34391571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Flow 'volume_create_manager' (39ab23b3-95e7-47ac-91a4-812cefc07234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:16:45 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-6c8aa311-70a3-4f89-a971-8cab35b17765 tempest-VolumesGetTest-438911491 None] Created volume successfully. Jul 08 01:16:45 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:16:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:16:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:16:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:45 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:16:45 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:46 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.336dc15e-52bf-4da1-bd18-5c3e3f318ad7" returned: 0 in 1.041s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.336dc15e-52bf-4da1-bd18-5c3e3f318ad7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:46 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:16:46 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.336dc15e-52bf-4da1-bd18-5c3e3f318ad7 Jul 08 01:16:46 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Flow 'volume_create_manager' (fdd39149-dd01-4c68-b392-013f4dff9043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:16:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b205f00-2c94-4954-bbd7-3da86e7dcb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:46 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.822s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:46 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:16:46 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:16:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread count: 28 {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:16:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread info: [<_MainThread(MainThread, started 134382216167552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:16:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b205f00-2c94-4954-bbd7-3da86e7dcb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-174024293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=634e91d2-4a24-4ce7-ac59-1966511262bf,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ac54fcd394484815b85bd40e4fd6c64a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=99b6fd94-7a69-42d2-a375-cb4d1c6b7914,status='creating',terminated_at=None,updated_at=2026-07-07T23:16:46Z,use_quota=True,user_id='be79671ce36445a3a7abfb1c95648f1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8ff8b5-4bf5-4f86-898c-3043d1cff718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8ff8b5-4bf5-4f86-898c-3043d1cff718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (714d29e7-69f1-4f6d-8836-1922aa593d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (714d29e7-69f1-4f6d-8836-1922aa593d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '634e91d2-4a24-4ce7-ac59-1966511262bf', 'volume_name': 'volume-634e91d2-4a24-4ce7-ac59-1966511262bf', 'volume_size': 1, 'source_volid': '99b6fd94-7a69-42d2-a375-cb4d1c6b7914', 'source_volstatus': 'available'}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c9fd91-5f6d-4377-8af9-ca2ddeb892d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c9fd91-5f6d-4377-8af9-ca2ddeb892d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (265173a8-c4e2-42f5-8984-cadc3b60a1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:46 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Volume 634e91d2-4a24-4ce7-ac59-1966511262bf: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-634e91d2-4a24-4ce7-ac59-1966511262bf', 'volume_size': 1, 'source_volid': '99b6fd94-7a69-42d2-a375-cb4d1c6b7914', 'source_volstatus': 'available'} Jul 08 01:16:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:46 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Cloning volume 99b6fd94-7a69-42d2-a375-cb4d1c6b7914 to volume 634e91d2-4a24-4ce7-ac59-1966511262bf Jul 08 01:16:46 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Creating offline snapshot 2bcd4c90-913e-415c-9074-47fa88cfacda of volume 99b6fd94-7a69-42d2-a375-cb4d1c6b7914 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:16:46 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84ce7f5-44d7-45a3-8283-95101f191861]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:46 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914 Jul 08 01:16:46 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:46 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12.336dc15e-52bf-4da1-bd18-5c3e3f318ad7" returned: 0 in 0.828s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:47 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-quobyte-336dc15e-52bf-4da1-bd18-5c3e3f318ad7" released by "_delete_snapshot" :: held 4.472s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:47 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-quobyte-e8fd02f1-d3c0-444f-8e71-d7de6a870a12" released by "delete_snapshot" :: held 4.507s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:47 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Created reservations ['fc384ca5-9659-4e57-ba77-e4604d315cd4', 'a521ebf1-62a0-4906-98e1-c08f4444301f', '492c6b14-9b2e-4370-8d4b-4dea8fd92ec0', '81b28259-a66f-4670-97cc-e73cc75f7e78'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:16:47 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Delete snapshot completed successfully. Jul 08 01:16:47 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-336dc15e-52bf-4da1-bd18-5c3e3f318ad7-delete_snapshot" released by "delete_snapshot" :: held 4.771s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:47 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Snapshots deleted, issuing volume delete {{(pid=87022) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 01:16:47 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "cinder-quobyte-e8fd02f1-d3c0-444f-8e71-d7de6a870a12" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:47 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-quobyte-e8fd02f1-d3c0-444f-8e71-d7de6a870a12" acquired by "delete_volume" :: waited 0.018s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:47 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed36c45-cef9-4531-b711-b8863e483707]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:47 devstack sudo[97660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12 Jul 08 01:16:47 devstack sudo[97660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:47 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914" returned: 0 in 1.068s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.2bcd4c90-913e-415c-9074-47fa88cfacda 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:47 devstack sudo[97664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.2bcd4c90-913e-415c-9074-47fa88cfacda 1G Jul 08 01:16:47 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:48 devstack sudo[97660]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12" returned: 0 in 0.919s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:48 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12 Jul 08 01:16:48 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:48 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.2bcd4c90-913e-415c-9074-47fa88cfacda 1G" returned: 0 in 0.918s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.2bcd4c90-913e-415c-9074-47fa88cfacda {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:48 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.2bcd4c90-913e-415c-9074-47fa88cfacda Jul 08 01:16:48 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:49 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e8fd02f1-d3c0-444f-8e71-d7de6a870a12" returned: 0 in 0.814s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:49 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-quobyte-e8fd02f1-d3c0-444f-8e71-d7de6a870a12" released by "delete_volume" :: held 1.821s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:49 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Created reservations ['53882d44-8b69-4fdf-baf4-e567f5905101', 'a08009b7-c7cb-4b65-afd1-c18ce6234906', '85498de4-b173-4401-afc7-204c5170d382', '17e54dfb-42c0-4b60-8fab-092eac9b55c0'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:16:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:49 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:16:49 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:16:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:49 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:16:49 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:49 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.2bcd4c90-913e-415c-9074-47fa88cfacda" returned: 0 in 1.022s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:49 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.2bcd4c90-913e-415c-9074-47fa88cfacda is being set with open permissions: ugo+rw Jul 08 01:16:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.2bcd4c90-913e-415c-9074-47fa88cfacda {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:49 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.2bcd4c90-913e-415c-9074-47fa88cfacda Jul 08 01:16:49 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:50 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.723s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:50 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:16:50 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Deleted volume successfully. Jul 08 01:16:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4011d2b6-219b-48b6-bf2e-0678adf23868 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-e8fd02f1-d3c0-444f-8e71-d7de6a870a12-delete_volume" released by "delete_volume" :: held 7.751s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:50 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.2bcd4c90-913e-415c-9074-47fa88cfacda" returned: 0 in 0.935s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:50 devstack sudo[97687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.info Jul 08 01:16:50 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-431c71b2-9fab-4779-8621-758ad0b5b513 tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "cinder-7043e87e-eba8-468e-b0d3-75d772073d80-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-431c71b2-9fab-4779-8621-758ad0b5b513 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-7043e87e-eba8-468e-b0d3-75d772073d80-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-431c71b2-9fab-4779-8621-758ad0b5b513 tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "cinder-quobyte-7043e87e-eba8-468e-b0d3-75d772073d80" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-431c71b2-9fab-4779-8621-758ad0b5b513 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-quobyte-7043e87e-eba8-468e-b0d3-75d772073d80" acquired by "delete_volume" :: waited 0.018s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:50 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c024d7a-8d8c-47f7-9dfb-9744c3b5607a]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-431c71b2-9fab-4779-8621-758ad0b5b513 tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7043e87e-eba8-468e-b0d3-75d772073d80 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:50 devstack sudo[97689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7043e87e-eba8-468e-b0d3-75d772073d80 Jul 08 01:16:50 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:51 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.info" returned: 0 in 0.822s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:51 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.info is being set with open permissions: ugo+rw Jul 08 01:16:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:51 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.info Jul 08 01:16:51 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:51 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-431c71b2-9fab-4779-8621-758ad0b5b513 tempest-VolumesDeleteCascade-165698782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7043e87e-eba8-468e-b0d3-75d772073d80" returned: 0 in 1.099s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-431c71b2-9fab-4779-8621-758ad0b5b513 tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7043e87e-eba8-468e-b0d3-75d772073d80 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:51 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7043e87e-eba8-468e-b0d3-75d772073d80 Jul 08 01:16:51 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:52 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.info" returned: 0 in 0.925s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:52 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Acquiring lock "cinder-quobyte-634e91d2-4a24-4ce7-ac59-1966511262bf" by "_copy_volume_from_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:52 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Lock "cinder-quobyte-634e91d2-4a24-4ce7-ac59-1966511262bf" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] snapshot: 2bcd4c90-913e-415c-9074-47fa88cfacda, volume: 634e91d2-4a24-4ce7-ac59-1966511262bf, {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:16:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:16:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:16:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:52 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a30ce93-a595-401d-a5ad-8c2ad6b1f63d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.2bcd4c90-913e-415c-9074-47fa88cfacda {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:52 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.2bcd4c90-913e-415c-9074-47fa88cfacda Jul 08 01:16:52 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:52 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-431c71b2-9fab-4779-8621-758ad0b5b513 tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7043e87e-eba8-468e-b0d3-75d772073d80" returned: 0 in 0.848s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:52 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-431c71b2-9fab-4779-8621-758ad0b5b513 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-quobyte-7043e87e-eba8-468e-b0d3-75d772073d80" released by "delete_volume" :: held 1.997s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:52 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-431c71b2-9fab-4779-8621-758ad0b5b513 tempest-VolumesDeleteCascade-165698782 None] Created reservations ['7ac4da3c-632b-49dd-8a08-8d6f32e6d2b2', '48082383-1d43-4af6-8aa3-317b1ffb770a', 'c42627e1-0404-4a65-aa39-3dfc2a1aae14', 'fb6246e6-51a0-492d-b3b0-78c365050d97'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:16:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-431c71b2-9fab-4779-8621-758ad0b5b513 tempest-VolumesDeleteCascade-165698782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-431c71b2-9fab-4779-8621-758ad0b5b513 tempest-VolumesDeleteCascade-165698782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-431c71b2-9fab-4779-8621-758ad0b5b513 tempest-VolumesDeleteCascade-165698782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:16:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-431c71b2-9fab-4779-8621-758ad0b5b513 tempest-VolumesDeleteCascade-165698782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:16:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-431c71b2-9fab-4779-8621-758ad0b5b513 tempest-VolumesDeleteCascade-165698782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-431c71b2-9fab-4779-8621-758ad0b5b513 tempest-VolumesDeleteCascade-165698782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:52 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:16:52 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:53 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.2bcd4c90-913e-415c-9074-47fa88cfacda" returned: 0 in 1.319s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:53 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:16:53 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] will copy from snapshot at /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914 {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:16:53 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Creating direct copy from snapshot {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:16:53 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75bad43-6640-430e-b893-fbf708e3c1c9]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:53 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914 Jul 08 01:16:53 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:53 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-431c71b2-9fab-4779-8621-758ad0b5b513 tempest-VolumesDeleteCascade-165698782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.098s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:53 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-431c71b2-9fab-4779-8621-758ad0b5b513 tempest-VolumesDeleteCascade-165698782 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:16:53 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-431c71b2-9fab-4779-8621-758ad0b5b513 tempest-VolumesDeleteCascade-165698782 None] Deleted volume successfully. Jul 08 01:16:54 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-431c71b2-9fab-4779-8621-758ad0b5b513 tempest-VolumesDeleteCascade-165698782 None] Lock "cinder-7043e87e-eba8-468e-b0d3-75d772073d80-delete_volume" released by "delete_volume" :: held 3.412s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:54 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914" returned: 0 in 1.045s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:54 devstack cinder-volume[87022]: DEBUG cinder.utils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Path /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-634e91d2-4a24-4ce7-ac59-1966511262bf not found in is_blk_device check {{(pid=87022) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:16:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-634e91d2-4a24-4ce7-ac59-1966511262bf {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:54 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-634e91d2-4a24-4ce7-ac59-1966511262bf Jul 08 01:16:54 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:01 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-634e91d2-4a24-4ce7-ac59-1966511262bf" returned: 0 in 7.076s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:01 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[219a9657-0c5f-4574-83d8-62708ffc7a01]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:17:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:01 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914 Jul 08 01:17:01 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:02 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:17:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Flow 'volume_create_manager' (6e0a5125-5f7c-4e1f-8148-471b59bf66ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:17:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b980f27-1f3c-4a41-84c7-d0295d36523e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b980f27-1f3c-4a41-84c7-d0295d36523e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-284749988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63661f0e-c7fe-4b7d-9588-c5e433b0b45e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13b8fec82127410c908e924d48b7929a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:17:03Z,use_quota=True,user_id='d36414ab270a4d76acd0ca00fdd9b52d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9119880-97de-4dd3-b11d-7b2bf87e55d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9119880-97de-4dd3-b11d-7b2bf87e55d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (941712ea-63ad-402e-8b16-6803db43fa59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (941712ea-63ad-402e-8b16-6803db43fa59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63661f0e-c7fe-4b7d-9588-c5e433b0b45e', 'volume_name': 'volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2685c675-c19c-4e68-9f8d-63f9d939fe7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2685c675-c19c-4e68-9f8d-63f9d939fe7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65342176-fe12-4f2d-9344-762f1eaaeb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:02 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Volume 63661f0e-c7fe-4b7d-9588-c5e433b0b45e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e', 'volume_size': 1} Jul 08 01:17:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:02 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=88,cinder:INSERT=32,cinder:UPDATE=132,cinder:DELETE=10 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:17:03 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914" returned: 0 in 1.230s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:03 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Image conversion details: src /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914, size 1024.00 MB, duration 7.08 sec, destination /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-634e91d2-4a24-4ce7-ac59-1966511262bf {{(pid=87022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:17:03 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Converted 1024.00 MB image at 144.70 MB/s Jul 08 01:17:03 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-634e91d2-4a24-4ce7-ac59-1966511262bf is being set with open permissions: ugo+rw Jul 08 01:17:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-634e91d2-4a24-4ce7-ac59-1966511262bf {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:03 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-634e91d2-4a24-4ce7-ac59-1966511262bf Jul 08 01:17:03 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:03 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-634e91d2-4a24-4ce7-ac59-1966511262bf" returned: 0 in 0.803s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:03 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Lock "cinder-quobyte-634e91d2-4a24-4ce7-ac59-1966511262bf" released by "_copy_volume_from_snapshot" :: held 11.614s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:17:03 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Acquiring lock "cinder-quobyte-2bcd4c90-913e-415c-9074-47fa88cfacda" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:17:03 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Lock "cinder-quobyte-2bcd4c90-913e-415c-9074-47fa88cfacda" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:17:03 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Deleting offline snapshot 2bcd4c90-913e-415c-9074-47fa88cfacda of volume 99b6fd94-7a69-42d2-a375-cb4d1c6b7914 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:17:03 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] snapshot_file for this snap is: volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.2bcd4c90-913e-415c-9074-47fa88cfacda {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:17:03 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d472961c-bbed-464c-a87d-6c6e3a66cf21]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:17:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.2bcd4c90-913e-415c-9074-47fa88cfacda {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:04 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.2bcd4c90-913e-415c-9074-47fa88cfacda Jul 08 01:17:04 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:04 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:17:04 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Flow 'volume_create_manager' (66a67860-3f9e-4b4d-88a6-444e389d1387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:17:04 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3df2b4-31ee-4450-8960-34fb3a4db8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:04 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3df2b4-31ee-4450-8960-34fb3a4db8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-823745928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd32694-ac86-41c8-b285-41784c0b6870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974cb75070b449578f27fc418a2f50fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:17:04Z,use_quota=True,user_id='fce4e95b129f446c8b22416eef44bae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:04 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a421c637-464b-4bf3-8299-a5902c1fa344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:04 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a421c637-464b-4bf3-8299-a5902c1fa344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:04 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf18855-9be4-40f6-8e0b-7f556675a09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:04 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf18855-9be4-40f6-8e0b-7f556675a09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcd32694-ac86-41c8-b285-41784c0b6870', 'volume_name': 'volume-fcd32694-ac86-41c8-b285-41784c0b6870', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:04 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbfa47c-d567-4768-ae1c-cde78b3acb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:04 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbfa47c-d567-4768-ae1c-cde78b3acb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:04 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef27aec-34d1-4920-aacf-09fdca1f3845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:04 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Volume fcd32694-ac86-41c8-b285-41784c0b6870: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcd32694-ac86-41c8-b285-41784c0b6870', 'volume_size': 1} Jul 08 01:17:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:04 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.2bcd4c90-913e-415c-9074-47fa88cfacda" returned: 0 in 0.825s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:17:04 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2ba069-1e9b-4354-b145-0e364e7c6519]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:17:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:04 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914 Jul 08 01:17:04 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:05 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914" returned: 0 in 0.877s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.2bcd4c90-913e-415c-9074-47fa88cfacda {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:05 devstack sudo[97784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.2bcd4c90-913e-415c-9074-47fa88cfacda Jul 08 01:17:05 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:06 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.2bcd4c90-913e-415c-9074-47fa88cfacda" returned: 0 in 0.825s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.2bcd4c90-913e-415c-9074-47fa88cfacda {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:06 devstack sudo[97790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.2bcd4c90-913e-415c-9074-47fa88cfacda Jul 08 01:17:06 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:07 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914.2bcd4c90-913e-415c-9074-47fa88cfacda" returned: 0 in 0.732s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:07 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Lock "cinder-quobyte-2bcd4c90-913e-415c-9074-47fa88cfacda" released by "_delete_snapshot" :: held 3.375s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:17:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.936s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.432s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:07 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-284749988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63661f0e-c7fe-4b7d-9588-c5e433b0b45e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13b8fec82127410c908e924d48b7929a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:17:03Z,use_quota=True,user_id='d36414ab270a4d76acd0ca00fdd9b52d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:17:07 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Creating volume 63661f0e-c7fe-4b7d-9588-c5e433b0b45e {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:17:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:07 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:17:07 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:17:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:07 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:17:07 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:17:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (265173a8-c4e2-42f5-8984-cadc3b60a1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-634e91d2-4a24-4ce7-ac59-1966511262bf', 'volume_size': 1, 'source_volid': '99b6fd94-7a69-42d2-a375-cb4d1c6b7914', 'source_volstatus': 'available'}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:07 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e 1073741824 Jul 08 01:17:07 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bb3d9a9-d696-45ff-aca4-78d0fb5cdde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:07 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Volume volume-634e91d2-4a24-4ce7-ac59-1966511262bf (634e91d2-4a24-4ce7-ac59-1966511262bf): created successfully Jul 08 01:17:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bb3d9a9-d696-45ff-aca4-78d0fb5cdde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Flow 'volume_create_manager' (fdd39149-dd01-4c68-b392-013f4dff9043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:17:07 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-5742b704-3852-4b32-9b55-af4adb1dabb6 tempest-VolumesGetTest-438911491 None] Created volume successfully. Jul 08 01:17:08 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e 1073741824" returned: 0 in 0.910s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:08 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e Jul 08 01:17:08 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:08 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e" returned: 0 in 0.719s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:08 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:17:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.367s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:08 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-823745928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd32694-ac86-41c8-b285-41784c0b6870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974cb75070b449578f27fc418a2f50fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:17:04Z,use_quota=True,user_id='fce4e95b129f446c8b22416eef44bae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:17:08 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Creating volume fcd32694-ac86-41c8-b285-41784c0b6870 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:17:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:08 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:17:08 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:17:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:08 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:17:08 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:17:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fcd32694-ac86-41c8-b285-41784c0b6870 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65342176-fe12-4f2d-9344-762f1eaaeb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54efb08f-0569-4c1f-8098-3affa078adc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:09 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fcd32694-ac86-41c8-b285-41784c0b6870 1073741824 Jul 08 01:17:09 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:09 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Volume volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e (63661f0e-c7fe-4b7d-9588-c5e433b0b45e): created successfully Jul 08 01:17:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54efb08f-0569-4c1f-8098-3affa078adc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Flow 'volume_create_manager' (6e0a5125-5f7c-4e1f-8148-471b59bf66ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:17:09 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-7a9b69d1-35b2-4d51-ac75-b7f8a76b80d3 tempest-VolumesActionsTest-1673967414 None] Created volume successfully. Jul 08 01:17:09 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:17:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Flow 'volume_create_manager' (e3cc7ea1-67f6-48ec-b7fc-d4c996f8279b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:17:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0938167-7bd7-4581-a8c0-6fa1ba7e6e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0938167-7bd7-4581-a8c0-6fa1ba7e6e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:17:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1509388709',display_name='tempest-VolumesGetTest-Volume-942376523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc45a68-6e16-4236-8406-f206ad966d0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac54fcd394484815b85bd40e4fd6c64a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:17:09Z,use_quota=True,user_id='be79671ce36445a3a7abfb1c95648f1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8dc986-2f2b-40a9-a90f-0bc0911615ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8dc986-2f2b-40a9-a90f-0bc0911615ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7089e573-93be-41c2-8dac-3f8b4010b956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7089e573-93be-41c2-8dac-3f8b4010b956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbc45a68-6e16-4236-8406-f206ad966d0a', 'volume_name': 'volume-dbc45a68-6e16-4236-8406-f206ad966d0a', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca05b5e1-4343-44c9-ac4f-863f6eab7915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca05b5e1-4343-44c9-ac4f-863f6eab7915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f97d39-d0d9-4a9f-a548-6e448d011176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:09 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Volume dbc45a68-6e16-4236-8406-f206ad966d0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbc45a68-6e16-4236-8406-f206ad966d0a', 'volume_size': 1} Jul 08 01:17:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:09 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fcd32694-ac86-41c8-b285-41784c0b6870 1073741824" returned: 0 in 0.942s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fcd32694-ac86-41c8-b285-41784c0b6870 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:09 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fcd32694-ac86-41c8-b285-41784c0b6870 Jul 08 01:17:09 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:10 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fcd32694-ac86-41c8-b285-41784c0b6870" returned: 0 in 0.776s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:17:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.388s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:17:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1509388709',display_name='tempest-VolumesGetTest-Volume-942376523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc45a68-6e16-4236-8406-f206ad966d0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac54fcd394484815b85bd40e4fd6c64a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:17:09Z,use_quota=True,user_id='be79671ce36445a3a7abfb1c95648f1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:17:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Creating volume dbc45a68-6e16-4236-8406-f206ad966d0a {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:17:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:17:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:17:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:17:10 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:17:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-dbc45a68-6e16-4236-8406-f206ad966d0a 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:10 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef27aec-34d1-4920-aacf-09fdca1f3845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcd32694-ac86-41c8-b285-41784c0b6870', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:10 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-dbc45a68-6e16-4236-8406-f206ad966d0a 1073741824 Jul 08 01:17:10 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:10 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32faa97f-5630-4172-a71e-c89fd31c0995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:10 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Volume volume-fcd32694-ac86-41c8-b285-41784c0b6870 (fcd32694-ac86-41c8-b285-41784c0b6870): created successfully Jul 08 01:17:10 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32faa97f-5630-4172-a71e-c89fd31c0995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:10 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Flow 'volume_create_manager' (66a67860-3f9e-4b4d-88a6-444e389d1387) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:17:10 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-3c84e74b-0761-402d-831f-58117af616ef tempest-VolumesTransfersV355Test-220655250 None] Created volume successfully. Jul 08 01:17:11 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-dbc45a68-6e16-4236-8406-f206ad966d0a 1073741824" returned: 0 in 1.177s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-dbc45a68-6e16-4236-8406-f206ad966d0a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:12 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-dbc45a68-6e16-4236-8406-f206ad966d0a Jul 08 01:17:12 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:12 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-dbc45a68-6e16-4236-8406-f206ad966d0a" returned: 0 in 0.919s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:12 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] <== create_volume: return (2159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:17:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.165s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f97d39-d0d9-4a9f-a548-6e448d011176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbc45a68-6e16-4236-8406-f206ad966d0a', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19bc6d0-2a73-42f1-95ed-55859f724b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:12 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-a11a277c-2a7a-44a7-949d-871ecc1e94a2 tempest-VolumesTransfersV355Test-994546066 None] Transfer volume completed successfully. Jul 08 01:17:12 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Volume volume-dbc45a68-6e16-4236-8406-f206ad966d0a (dbc45a68-6e16-4236-8406-f206ad966d0a): created successfully Jul 08 01:17:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19bc6d0-2a73-42f1-95ed-55859f724b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Flow 'volume_create_manager' (e3cc7ea1-67f6-48ec-b7fc-d4c996f8279b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:17:13 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-b1b1b00a-e2ae-4f4d-9c6e-12c73cc0292b tempest-VolumesGetTest-438911491 None] Created volume successfully. Jul 08 01:17:13 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-39479ac7-5be3-4d10-90e3-70f9cf30f8f8 tempest-VolumesGetTest-438911491 None] Acquiring lock "cinder-dbc45a68-6e16-4236-8406-f206ad966d0a-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:17:13 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-39479ac7-5be3-4d10-90e3-70f9cf30f8f8 tempest-VolumesGetTest-438911491 None] Lock "cinder-dbc45a68-6e16-4236-8406-f206ad966d0a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:17:13 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-39479ac7-5be3-4d10-90e3-70f9cf30f8f8 tempest-VolumesGetTest-438911491 None] Acquiring lock "cinder-quobyte-dbc45a68-6e16-4236-8406-f206ad966d0a" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:17:13 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-39479ac7-5be3-4d10-90e3-70f9cf30f8f8 tempest-VolumesGetTest-438911491 None] Lock "cinder-quobyte-dbc45a68-6e16-4236-8406-f206ad966d0a" acquired by "delete_volume" :: waited 0.029s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:17:13 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b278f2de-26c5-49ff-afec-b465fbc1600d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:17:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-39479ac7-5be3-4d10-90e3-70f9cf30f8f8 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-dbc45a68-6e16-4236-8406-f206ad966d0a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:14 devstack sudo[97901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-dbc45a68-6e16-4236-8406-f206ad966d0a Jul 08 01:17:14 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:14 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-134a150d-3dab-415c-899d-123ba55a52dc tempest-VolumesTransfersV355Test-859762277 None] Acquiring lock "cinder-fcd32694-ac86-41c8-b285-41784c0b6870-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:17:14 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-134a150d-3dab-415c-899d-123ba55a52dc tempest-VolumesTransfersV355Test-859762277 None] Lock "cinder-fcd32694-ac86-41c8-b285-41784c0b6870-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:17:14 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-134a150d-3dab-415c-899d-123ba55a52dc tempest-VolumesTransfersV355Test-859762277 None] Acquiring lock "cinder-quobyte-fcd32694-ac86-41c8-b285-41784c0b6870" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:17:14 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-134a150d-3dab-415c-899d-123ba55a52dc tempest-VolumesTransfersV355Test-859762277 None] Lock "cinder-quobyte-fcd32694-ac86-41c8-b285-41784c0b6870" acquired by "delete_volume" :: waited 0.022s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:17:14 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af59fae-f3b5-4112-b9b5-93215b2489d4]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:17:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-134a150d-3dab-415c-899d-123ba55a52dc tempest-VolumesTransfersV355Test-859762277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fcd32694-ac86-41c8-b285-41784c0b6870 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:14 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fcd32694-ac86-41c8-b285-41784c0b6870 Jul 08 01:17:14 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:14 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-39479ac7-5be3-4d10-90e3-70f9cf30f8f8 tempest-VolumesGetTest-438911491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-dbc45a68-6e16-4236-8406-f206ad966d0a" returned: 0 in 0.996s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-39479ac7-5be3-4d10-90e3-70f9cf30f8f8 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-dbc45a68-6e16-4236-8406-f206ad966d0a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:14 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-dbc45a68-6e16-4236-8406-f206ad966d0a Jul 08 01:17:14 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:15 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-134a150d-3dab-415c-899d-123ba55a52dc tempest-VolumesTransfersV355Test-859762277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fcd32694-ac86-41c8-b285-41784c0b6870" returned: 0 in 0.943s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-134a150d-3dab-415c-899d-123ba55a52dc tempest-VolumesTransfersV355Test-859762277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fcd32694-ac86-41c8-b285-41784c0b6870 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:15 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fcd32694-ac86-41c8-b285-41784c0b6870 Jul 08 01:17:15 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:15 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-39479ac7-5be3-4d10-90e3-70f9cf30f8f8 tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-dbc45a68-6e16-4236-8406-f206ad966d0a" returned: 0 in 0.798s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-39479ac7-5be3-4d10-90e3-70f9cf30f8f8 tempest-VolumesGetTest-438911491 None] Lock "cinder-quobyte-dbc45a68-6e16-4236-8406-f206ad966d0a" released by "delete_volume" :: held 1.859s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:17:15 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-39479ac7-5be3-4d10-90e3-70f9cf30f8f8 tempest-VolumesGetTest-438911491 None] Created reservations ['c84f9bef-375f-4759-b365-07c309aa9bd9', 'cfa01073-17c3-493a-981c-720341e6a91f', 'dc8fb532-9902-4c3f-a569-6d4dbdc5ca45', 'be628ae5-c679-4ed8-b7bd-71609cc1cae9'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:17:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-39479ac7-5be3-4d10-90e3-70f9cf30f8f8 tempest-VolumesGetTest-438911491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-39479ac7-5be3-4d10-90e3-70f9cf30f8f8 tempest-VolumesGetTest-438911491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:15 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-39479ac7-5be3-4d10-90e3-70f9cf30f8f8 tempest-VolumesGetTest-438911491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:17:15 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-39479ac7-5be3-4d10-90e3-70f9cf30f8f8 tempest-VolumesGetTest-438911491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:17:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-39479ac7-5be3-4d10-90e3-70f9cf30f8f8 tempest-VolumesGetTest-438911491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-39479ac7-5be3-4d10-90e3-70f9cf30f8f8 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:15 devstack sudo[97923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:17:15 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:15 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-134a150d-3dab-415c-899d-123ba55a52dc tempest-VolumesTransfersV355Test-859762277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fcd32694-ac86-41c8-b285-41784c0b6870" returned: 0 in 0.743s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-134a150d-3dab-415c-899d-123ba55a52dc tempest-VolumesTransfersV355Test-859762277 None] Lock "cinder-quobyte-fcd32694-ac86-41c8-b285-41784c0b6870" released by "delete_volume" :: held 1.753s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:17:16 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-134a150d-3dab-415c-899d-123ba55a52dc tempest-VolumesTransfersV355Test-859762277 None] Created reservations ['c5e12dd1-c771-42d9-81ae-a746706c8db8', '4e24aefe-e735-40dc-9b89-f7166960f092', 'b1ecbecf-3b5f-47fb-9a00-56034c9d0417', 'b8a58de7-9bff-4437-a913-8e9dccd4319b'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:17:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cb6df7be-21f9-4b36-bf96-06c559b015b8 tempest-VolumesGetTest-438911491 None] Acquiring lock "cinder-634e91d2-4a24-4ce7-ac59-1966511262bf-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:17:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cb6df7be-21f9-4b36-bf96-06c559b015b8 tempest-VolumesGetTest-438911491 None] Lock "cinder-634e91d2-4a24-4ce7-ac59-1966511262bf-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:17:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-134a150d-3dab-415c-899d-123ba55a52dc tempest-VolumesTransfersV355Test-859762277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-134a150d-3dab-415c-899d-123ba55a52dc tempest-VolumesTransfersV355Test-859762277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-134a150d-3dab-415c-899d-123ba55a52dc tempest-VolumesTransfersV355Test-859762277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:17:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-134a150d-3dab-415c-899d-123ba55a52dc tempest-VolumesTransfersV355Test-859762277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:17:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-134a150d-3dab-415c-899d-123ba55a52dc tempest-VolumesTransfersV355Test-859762277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-134a150d-3dab-415c-899d-123ba55a52dc tempest-VolumesTransfersV355Test-859762277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cb6df7be-21f9-4b36-bf96-06c559b015b8 tempest-VolumesGetTest-438911491 None] Acquiring lock "cinder-quobyte-634e91d2-4a24-4ce7-ac59-1966511262bf" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:17:16 devstack sudo[97925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:17:16 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cb6df7be-21f9-4b36-bf96-06c559b015b8 tempest-VolumesGetTest-438911491 None] Lock "cinder-quobyte-634e91d2-4a24-4ce7-ac59-1966511262bf" acquired by "delete_volume" :: waited 0.039s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:17:16 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[11787dbd-5f80-4e11-8c6b-da9dc370876c]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:17:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cb6df7be-21f9-4b36-bf96-06c559b015b8 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-634e91d2-4a24-4ce7-ac59-1966511262bf {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:16 devstack sudo[97927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-634e91d2-4a24-4ce7-ac59-1966511262bf Jul 08 01:17:16 devstack sudo[97927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:17 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-39479ac7-5be3-4d10-90e3-70f9cf30f8f8 tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.353s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:17 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-39479ac7-5be3-4d10-90e3-70f9cf30f8f8 tempest-VolumesGetTest-438911491 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:17:17 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-39479ac7-5be3-4d10-90e3-70f9cf30f8f8 tempest-VolumesGetTest-438911491 None] Deleted volume successfully. Jul 08 01:17:17 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-39479ac7-5be3-4d10-90e3-70f9cf30f8f8 tempest-VolumesGetTest-438911491 None] Lock "cinder-dbc45a68-6e16-4236-8406-f206ad966d0a-delete_volume" released by "delete_volume" :: held 3.550s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:17:17 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:17:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Flow 'volume_create_manager' (f36d92e3-de4b-4520-a965-fcd010d4e1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:17:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e35b663-8cc5-4ac6-9608-2c1d8b61d35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e35b663-8cc5-4ac6-9608-2c1d8b61d35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-680319714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bc76f24-af32-4819-b7f6-e92dea11d7e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974cb75070b449578f27fc418a2f50fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:17:18Z,use_quota=True,user_id='fce4e95b129f446c8b22416eef44bae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa06b09c-03c0-465e-af3d-0951fc3b679c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa06b09c-03c0-465e-af3d-0951fc3b679c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (115269e6-518b-4ff3-86e0-583c2a84871e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (115269e6-518b-4ff3-86e0-583c2a84871e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bc76f24-af32-4819-b7f6-e92dea11d7e7', 'volume_name': 'volume-3bc76f24-af32-4819-b7f6-e92dea11d7e7', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f944a74b-1878-4218-b336-ae77e43e0629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f944a74b-1878-4218-b336-ae77e43e0629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7601ea56-f4be-43e1-b289-7257bb019516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:17 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Volume 3bc76f24-af32-4819-b7f6-e92dea11d7e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bc76f24-af32-4819-b7f6-e92dea11d7e7', 'volume_size': 1} Jul 08 01:17:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-680319714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bc76f24-af32-4819-b7f6-e92dea11d7e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974cb75070b449578f27fc418a2f50fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:17:18Z,use_quota=True,user_id='fce4e95b129f446c8b22416eef44bae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:17:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Creating volume 3bc76f24-af32-4819-b7f6-e92dea11d7e7 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:17:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:17:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:17:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:17:17 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:17:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3bc76f24-af32-4819-b7f6-e92dea11d7e7 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:17 devstack sudo[97931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3bc76f24-af32-4819-b7f6-e92dea11d7e7 1073741824 Jul 08 01:17:17 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:18 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-134a150d-3dab-415c-899d-123ba55a52dc tempest-VolumesTransfersV355Test-859762277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.851s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:18 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-134a150d-3dab-415c-899d-123ba55a52dc tempest-VolumesTransfersV355Test-859762277 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:17:18 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-134a150d-3dab-415c-899d-123ba55a52dc tempest-VolumesTransfersV355Test-859762277 None] Deleted volume successfully. Jul 08 01:17:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-134a150d-3dab-415c-899d-123ba55a52dc tempest-VolumesTransfersV355Test-859762277 None] Lock "cinder-fcd32694-ac86-41c8-b285-41784c0b6870-delete_volume" released by "delete_volume" :: held 4.173s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:17:18 devstack sudo[97927]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cb6df7be-21f9-4b36-bf96-06c559b015b8 tempest-VolumesGetTest-438911491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-634e91d2-4a24-4ce7-ac59-1966511262bf" returned: 0 in 1.884s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cb6df7be-21f9-4b36-bf96-06c559b015b8 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-634e91d2-4a24-4ce7-ac59-1966511262bf {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:18 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-634e91d2-4a24-4ce7-ac59-1966511262bf Jul 08 01:17:18 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:19 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3bc76f24-af32-4819-b7f6-e92dea11d7e7 1073741824" returned: 0 in 1.695s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3bc76f24-af32-4819-b7f6-e92dea11d7e7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:19 devstack sudo[97961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3bc76f24-af32-4819-b7f6-e92dea11d7e7 Jul 08 01:17:19 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:19 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cb6df7be-21f9-4b36-bf96-06c559b015b8 tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-634e91d2-4a24-4ce7-ac59-1966511262bf" returned: 0 in 1.150s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cb6df7be-21f9-4b36-bf96-06c559b015b8 tempest-VolumesGetTest-438911491 None] Lock "cinder-quobyte-634e91d2-4a24-4ce7-ac59-1966511262bf" released by "delete_volume" :: held 3.135s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:17:19 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-cb6df7be-21f9-4b36-bf96-06c559b015b8 tempest-VolumesGetTest-438911491 None] Created reservations ['59059067-295d-48ca-971f-1378640a0896', '57f33669-8208-42c5-8a42-82b4e8a14208', 'e20c50f5-b88a-41d6-9bb1-0fde20673aaf', '05264d0f-52b5-4d56-a4ad-5a06e7fea6a9'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:17:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-cb6df7be-21f9-4b36-bf96-06c559b015b8 tempest-VolumesGetTest-438911491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-cb6df7be-21f9-4b36-bf96-06c559b015b8 tempest-VolumesGetTest-438911491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-cb6df7be-21f9-4b36-bf96-06c559b015b8 tempest-VolumesGetTest-438911491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:17:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-cb6df7be-21f9-4b36-bf96-06c559b015b8 tempest-VolumesGetTest-438911491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:17:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-cb6df7be-21f9-4b36-bf96-06c559b015b8 tempest-VolumesGetTest-438911491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cb6df7be-21f9-4b36-bf96-06c559b015b8 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:19 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:17:19 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:20 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3bc76f24-af32-4819-b7f6-e92dea11d7e7" returned: 0 in 0.990s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:20 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] <== create_volume: return (2755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:17:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.758s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:20 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7601ea56-f4be-43e1-b289-7257bb019516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bc76f24-af32-4819-b7f6-e92dea11d7e7', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:20 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39e792ad-c432-4435-84e0-698b9176df14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:20 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Volume volume-3bc76f24-af32-4819-b7f6-e92dea11d7e7 (3bc76f24-af32-4819-b7f6-e92dea11d7e7): created successfully Jul 08 01:17:20 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39e792ad-c432-4435-84e0-698b9176df14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:20 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Flow 'volume_create_manager' (f36d92e3-de4b-4520-a965-fcd010d4e1f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:17:20 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-37da42e9-51ee-4a1f-9ea5-bc3d5b82635e tempest-VolumesTransfersV355Test-220655250 None] Created volume successfully. Jul 08 01:17:20 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cb6df7be-21f9-4b36-bf96-06c559b015b8 tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.812s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:20 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-cb6df7be-21f9-4b36-bf96-06c559b015b8 tempest-VolumesGetTest-438911491 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:17:20 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-cb6df7be-21f9-4b36-bf96-06c559b015b8 tempest-VolumesGetTest-438911491 None] Deleted volume successfully. Jul 08 01:17:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cb6df7be-21f9-4b36-bf96-06c559b015b8 tempest-VolumesGetTest-438911491 None] Lock "cinder-634e91d2-4a24-4ce7-ac59-1966511262bf-delete_volume" released by "delete_volume" :: held 4.558s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:17:21 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6b6f7695-61d1-4c65-b9e2-b155ec0510d0 tempest-VolumesGetTest-438911491 None] Acquiring lock "cinder-99b6fd94-7a69-42d2-a375-cb4d1c6b7914-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:17:21 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6b6f7695-61d1-4c65-b9e2-b155ec0510d0 tempest-VolumesGetTest-438911491 None] Lock "cinder-99b6fd94-7a69-42d2-a375-cb4d1c6b7914-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:17:21 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6b6f7695-61d1-4c65-b9e2-b155ec0510d0 tempest-VolumesGetTest-438911491 None] Acquiring lock "cinder-quobyte-99b6fd94-7a69-42d2-a375-cb4d1c6b7914" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:17:21 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6b6f7695-61d1-4c65-b9e2-b155ec0510d0 tempest-VolumesGetTest-438911491 None] Lock "cinder-quobyte-99b6fd94-7a69-42d2-a375-cb4d1c6b7914" acquired by "delete_volume" :: waited 0.025s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:17:21 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2486eee3-3f35-4082-a851-06752c75c89c]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:17:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b6f7695-61d1-4c65-b9e2-b155ec0510d0 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:21 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914 Jul 08 01:17:21 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:21 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-dd43284a-de10-4816-80e3-967ac1901d2d tempest-VolumesTransfersV355Test-859762277 None] Acquiring lock "cinder-3bc76f24-af32-4819-b7f6-e92dea11d7e7-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:17:21 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-dd43284a-de10-4816-80e3-967ac1901d2d tempest-VolumesTransfersV355Test-859762277 None] Lock "cinder-3bc76f24-af32-4819-b7f6-e92dea11d7e7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:17:21 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-dd43284a-de10-4816-80e3-967ac1901d2d tempest-VolumesTransfersV355Test-859762277 None] Acquiring lock "cinder-quobyte-3bc76f24-af32-4819-b7f6-e92dea11d7e7" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:17:21 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-dd43284a-de10-4816-80e3-967ac1901d2d tempest-VolumesTransfersV355Test-859762277 None] Lock "cinder-quobyte-3bc76f24-af32-4819-b7f6-e92dea11d7e7" acquired by "delete_volume" :: waited 0.015s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:17:21 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db7953a-83ac-47df-bcc0-07e5915193be]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:17:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-dd43284a-de10-4816-80e3-967ac1901d2d tempest-VolumesTransfersV355Test-859762277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3bc76f24-af32-4819-b7f6-e92dea11d7e7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:21 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3bc76f24-af32-4819-b7f6-e92dea11d7e7 Jul 08 01:17:21 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:22 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b6f7695-61d1-4c65-b9e2-b155ec0510d0 tempest-VolumesGetTest-438911491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914" returned: 0 in 0.896s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b6f7695-61d1-4c65-b9e2-b155ec0510d0 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:22 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914 Jul 08 01:17:22 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:22 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-dd43284a-de10-4816-80e3-967ac1901d2d tempest-VolumesTransfersV355Test-859762277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3bc76f24-af32-4819-b7f6-e92dea11d7e7" returned: 0 in 0.926s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-dd43284a-de10-4816-80e3-967ac1901d2d tempest-VolumesTransfersV355Test-859762277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3bc76f24-af32-4819-b7f6-e92dea11d7e7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:22 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3bc76f24-af32-4819-b7f6-e92dea11d7e7 Jul 08 01:17:22 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:23 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b6f7695-61d1-4c65-b9e2-b155ec0510d0 tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-99b6fd94-7a69-42d2-a375-cb4d1c6b7914" returned: 0 in 0.865s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:23 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6b6f7695-61d1-4c65-b9e2-b155ec0510d0 tempest-VolumesGetTest-438911491 None] Lock "cinder-quobyte-99b6fd94-7a69-42d2-a375-cb4d1c6b7914" released by "delete_volume" :: held 1.887s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:17:23 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-6b6f7695-61d1-4c65-b9e2-b155ec0510d0 tempest-VolumesGetTest-438911491 None] Created reservations ['7f3ddd08-5965-4807-bbb1-c5874cfdec98', '1738deba-8083-41fb-949c-2524a88cf692', '8f4f65a5-6caa-4120-b4fe-1acfc16d3a81', '736e2391-332b-42f9-a2e4-0d4e41b276ac'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:17:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6b6f7695-61d1-4c65-b9e2-b155ec0510d0 tempest-VolumesGetTest-438911491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6b6f7695-61d1-4c65-b9e2-b155ec0510d0 tempest-VolumesGetTest-438911491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-6b6f7695-61d1-4c65-b9e2-b155ec0510d0 tempest-VolumesGetTest-438911491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:17:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-6b6f7695-61d1-4c65-b9e2-b155ec0510d0 tempest-VolumesGetTest-438911491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:17:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6b6f7695-61d1-4c65-b9e2-b155ec0510d0 tempest-VolumesGetTest-438911491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b6f7695-61d1-4c65-b9e2-b155ec0510d0 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:23 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:17:23 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:23 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-dd43284a-de10-4816-80e3-967ac1901d2d tempest-VolumesTransfersV355Test-859762277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3bc76f24-af32-4819-b7f6-e92dea11d7e7" returned: 0 in 0.878s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:23 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-dd43284a-de10-4816-80e3-967ac1901d2d tempest-VolumesTransfersV355Test-859762277 None] Lock "cinder-quobyte-3bc76f24-af32-4819-b7f6-e92dea11d7e7" released by "delete_volume" :: held 1.863s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:17:23 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-dd43284a-de10-4816-80e3-967ac1901d2d tempest-VolumesTransfersV355Test-859762277 None] Created reservations ['b612fbeb-48be-4dda-a057-349d6d2d91b4', '9b03393f-1c23-46ea-9622-a303f68108e2', '7eecca70-47ae-495f-b735-b38cd787bf0d', '04a4d443-f651-4cc2-a52a-cf8203e8aff3'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:17:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-dd43284a-de10-4816-80e3-967ac1901d2d tempest-VolumesTransfersV355Test-859762277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-dd43284a-de10-4816-80e3-967ac1901d2d tempest-VolumesTransfersV355Test-859762277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-dd43284a-de10-4816-80e3-967ac1901d2d tempest-VolumesTransfersV355Test-859762277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:17:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-dd43284a-de10-4816-80e3-967ac1901d2d tempest-VolumesTransfersV355Test-859762277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:17:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-dd43284a-de10-4816-80e3-967ac1901d2d tempest-VolumesTransfersV355Test-859762277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-dd43284a-de10-4816-80e3-967ac1901d2d tempest-VolumesTransfersV355Test-859762277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:24 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:17:24 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:24 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b6f7695-61d1-4c65-b9e2-b155ec0510d0 tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.377s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:24 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-6b6f7695-61d1-4c65-b9e2-b155ec0510d0 tempest-VolumesGetTest-438911491 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:17:24 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-6b6f7695-61d1-4c65-b9e2-b155ec0510d0 tempest-VolumesGetTest-438911491 None] Deleted volume successfully. Jul 08 01:17:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6b6f7695-61d1-4c65-b9e2-b155ec0510d0 tempest-VolumesGetTest-438911491 None] Lock "cinder-99b6fd94-7a69-42d2-a375-cb4d1c6b7914-delete_volume" released by "delete_volume" :: held 3.759s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:17:25 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-dd43284a-de10-4816-80e3-967ac1901d2d tempest-VolumesTransfersV355Test-859762277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.252s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:25 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-dd43284a-de10-4816-80e3-967ac1901d2d tempest-VolumesTransfersV355Test-859762277 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:17:25 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-dd43284a-de10-4816-80e3-967ac1901d2d tempest-VolumesTransfersV355Test-859762277 None] Deleted volume successfully. Jul 08 01:17:26 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-dd43284a-de10-4816-80e3-967ac1901d2d tempest-VolumesTransfersV355Test-859762277 None] Lock "cinder-3bc76f24-af32-4819-b7f6-e92dea11d7e7-delete_volume" released by "delete_volume" :: held 4.786s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:17:30 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:UPDATE=102,cinder:SELECT=84,cinder:INSERT=24,cinder:DELETE=9 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:17:30 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:17:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Flow 'volume_create_manager' (7deaacce-1289-42be-a454-e196701fdb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:17:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0af6ef96-74d9-4a1a-8a00-06509f87e2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0af6ef96-74d9-4a1a-8a00-06509f87e2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1301914739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d785833b-71de-44af-af85-88af3e43b4a9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ac54fcd394484815b85bd40e4fd6c64a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:17:30Z,use_quota=True,user_id='be79671ce36445a3a7abfb1c95648f1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f31f41cf-af13-4df2-875c-7b79b6799cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f31f41cf-af13-4df2-875c-7b79b6799cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d3d25f-80eb-4be1-ae86-3f8874c6547b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:30 devstack cinder-volume[87022]: DEBUG cinder.image.glance [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Creating Keystone auth plugin from conf {{(pid=87022) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:17:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d3d25f-80eb-4be1-ae86-3f8874c6547b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd785833b-71de-44af-af85-88af3e43b4a9', 'volume_name': 'volume-d785833b-71de-44af-af85-88af3e43b4a9', 'volume_size': 1, 'image_id': 'f4d67a52-db18-4750-abc4-5b7335c6e867', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4d67a52-db18-4750-abc4-5b7335c6e867', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81fea2dfa47f49cba26ad62301512b69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4d67a52-db18-4750-abc4-5b7335c6e867', 'created_at': datetime.datetime(2026, 7, 7, 22, 58, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 22, 58, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4d67a52-db18-4750-abc4-5b7335c6e867/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc9ae03-3159-4b0c-bc26-abf8e42acd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc9ae03-3159-4b0c-bc26-abf8e42acd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c90198f-9849-48a0-9ebb-2b69c4bcca9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:30 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Volume d785833b-71de-44af-af85-88af3e43b4a9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d785833b-71de-44af-af85-88af3e43b4a9', 'volume_size': 1, 'image_id': 'f4d67a52-db18-4750-abc4-5b7335c6e867', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4d67a52-db18-4750-abc4-5b7335c6e867', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81fea2dfa47f49cba26ad62301512b69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4d67a52-db18-4750-abc4-5b7335c6e867', 'created_at': datetime.datetime(2026, 7, 7, 22, 58, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 22, 58, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4d67a52-db18-4750-abc4-5b7335c6e867/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 01:17:30 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Trying to clone d785833b-71de-44af-af85-88af3e43b4a9 from image f4d67a52-db18-4750-abc4-5b7335c6e867 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f4d67a52-db18-4750-abc4-5b7335c6e867', 'metadata': {}}]). {{(pid=87022) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:17:31 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_71ckk0fxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87022) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:17:31 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Image download 20.69 MB at 20.69 MB/s Jul 08 01:17:31 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ad503d-d08e-45bd-a8ab-3b82f9af782d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:17:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_71ckk0fxdevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:31 devstack sudo[98071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_71ckk0fxdevstack@QuobyteHD Jul 08 01:17:31 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a8b95375-7d58-485e-9b6e-c6e678badecd tempest-VolumesActionsTest-1673967414 None] Acquiring lock "cinder-63661f0e-c7fe-4b7d-9588-c5e433b0b45e" by "attach_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:17:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a8b95375-7d58-485e-9b6e-c6e678badecd tempest-VolumesActionsTest-1673967414 None] Lock "cinder-63661f0e-c7fe-4b7d-9588-c5e433b0b45e" acquired by "attach_volume" :: waited 0.034s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:17:31 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-a8b95375-7d58-485e-9b6e-c6e678badecd tempest-VolumesActionsTest-1673967414 None] Attaching volume 63661f0e-c7fe-4b7d-9588-c5e433b0b45e to instance a14cec16-096c-417b-9dd8-5fd8f9524399 at mountpoint /dev/vdb on host None. Jul 08 01:17:31 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-a8b95375-7d58-485e-9b6e-c6e678badecd tempest-VolumesActionsTest-1673967414 None] Attach volume completed successfully. Jul 08 01:17:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a8b95375-7d58-485e-9b6e-c6e678badecd tempest-VolumesActionsTest-1673967414 None] Lock "cinder-63661f0e-c7fe-4b7d-9588-c5e433b0b45e" released by "attach_volume" :: held 0.156s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:17:32 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7aa67a52-cb24-4ddb-9393-b099cffbed81 tempest-VolumesActionsTest-1673967414 None] Acquiring lock "cinder-63661f0e-c7fe-4b7d-9588-c5e433b0b45e-detach_volume" by "detach_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:17:32 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7aa67a52-cb24-4ddb-9393-b099cffbed81 tempest-VolumesActionsTest-1673967414 None] Lock "cinder-63661f0e-c7fe-4b7d-9588-c5e433b0b45e-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:17:32 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-7aa67a52-cb24-4ddb-9393-b099cffbed81 tempest-VolumesActionsTest-1673967414 None] Detaching volume 63661f0e-c7fe-4b7d-9588-c5e433b0b45e from instance a14cec16-096c-417b-9dd8-5fd8f9524399. Jul 08 01:17:32 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-7aa67a52-cb24-4ddb-9393-b099cffbed81 tempest-VolumesActionsTest-1673967414 None] Detach volume completed successfully. Jul 08 01:17:32 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7aa67a52-cb24-4ddb-9393-b099cffbed81 tempest-VolumesActionsTest-1673967414 None] Lock "cinder-63661f0e-c7fe-4b7d-9588-c5e433b0b45e-detach_volume" released by "detach_volume" :: held 0.093s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:17:32 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_71ckk0fxdevstack@QuobyteHD" returned: 0 in 1.198s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:32 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Temporary image f4d67a52-db18-4750-abc4-5b7335c6e867 is fetched for user be79671ce36445a3a7abfb1c95648f1c. {{(pid=87022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:17:32 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a776d0-57c0-42da-98da-8dc803e47dc9]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:17:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_71ckk0fxdevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:32 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_71ckk0fxdevstack@QuobyteHD Jul 08 01:17:32 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:33 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_71ckk0fxdevstack@QuobyteHD" returned: 0 in 0.982s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:33 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1301914739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d785833b-71de-44af-af85-88af3e43b4a9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ac54fcd394484815b85bd40e4fd6c64a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:17:30Z,use_quota=True,user_id='be79671ce36445a3a7abfb1c95648f1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:17:33 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Creating volume d785833b-71de-44af-af85-88af3e43b4a9 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:17:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:33 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:17:33 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:17:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:33 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:17:33 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:17:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:33 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9 1073741824 Jul 08 01:17:33 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:34 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9 1073741824" returned: 0 in 1.088s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:34 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9 Jul 08 01:17:34 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:35 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9" returned: 0 in 1.102s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:35 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] <== create_volume: return (2266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:17:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.270s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:35 devstack cinder-volume[87022]: DEBUG cinder.volume.volume_utils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Attempting download of f4d67a52-db18-4750-abc4-5b7335c6e867 ((None, [{'url': 'file:///opt/stack/data/glance/images/f4d67a52-db18-4750-abc4-5b7335c6e867', 'metadata': {}}])) to volume d785833b-71de-44af-af85-88af3e43b4a9. {{(pid=87022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:17:36 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc1f23f-c020-4ddd-97ed-62aa3bd94f67]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:17:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4d67a52-db18-4750-abc4-5b7335c6e867_x1ucle8o {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:36 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4d67a52-db18-4750-abc4-5b7335c6e867_x1ucle8o Jul 08 01:17:36 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:36 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4d67a52-db18-4750-abc4-5b7335c6e867_x1ucle8o" returned: 0 in 0.926s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4d67a52-db18-4750-abc4-5b7335c6e867_x1ucle8o {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:37 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4d67a52-db18-4750-abc4-5b7335c6e867_x1ucle8o Jul 08 01:17:37 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:37 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4d67a52-db18-4750-abc4-5b7335c6e867_x1ucle8o" returned: 1 in 0.754s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4d67a52-db18-4750-abc4-5b7335c6e867_x1ucle8o' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:17:37 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccbcb2c-70ad-4c19-9f84-6f73648312c1]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:17:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_71ckk0fxdevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:37 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_71ckk0fxdevstack@QuobyteHD Jul 08 01:17:37 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:38 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_71ckk0fxdevstack@QuobyteHD" returned: 0 in 0.783s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:38 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] f4d67a52-db18-4750-abc4-5b7335c6e867 was qcow2, converting to raw {{(pid=87022) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:17:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_71ckk0fxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:38 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_71ckk0fxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9 Jul 08 01:17:38 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:38 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:17:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Flow 'volume_create_manager' (9770454b-6fd4-4105-89f6-96bb30f0a860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:17:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20257283-9f37-438e-bff3-fa3ce4ce498a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20257283-9f37-438e-bff3-fa3ce4ce498a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1074513922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efe02e37-2452-4726-b099-86f9194b05b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f677cfc0a60d47e7904b1d650ade10dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:17:39Z,use_quota=True,user_id='a02d5b0c82784194a84ce2f7e49bd1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20fd9d4c-f594-4926-91d6-5171131dffac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20fd9d4c-f594-4926-91d6-5171131dffac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9efe26-2dc2-4a0c-b57a-5aaea5a066e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9efe26-2dc2-4a0c-b57a-5aaea5a066e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efe02e37-2452-4726-b099-86f9194b05b4', 'volume_name': 'volume-efe02e37-2452-4726-b099-86f9194b05b4', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6fc9a15-a24a-44a9-92cc-df89f8433ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6fc9a15-a24a-44a9-92cc-df89f8433ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46cb9359-b7f1-4f12-b3be-49ad8ed3f227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:39 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Volume efe02e37-2452-4726-b099-86f9194b05b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efe02e37-2452-4726-b099-86f9194b05b4', 'volume_size': 1} Jul 08 01:17:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:39 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1074513922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efe02e37-2452-4726-b099-86f9194b05b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f677cfc0a60d47e7904b1d650ade10dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:17:39Z,use_quota=True,user_id='a02d5b0c82784194a84ce2f7e49bd1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:17:39 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Creating volume efe02e37-2452-4726-b099-86f9194b05b4 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:17:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:39 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:17:39 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:17:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:39 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:17:39 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:17:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-efe02e37-2452-4726-b099-86f9194b05b4 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:39 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-efe02e37-2452-4726-b099-86f9194b05b4 1073741824 Jul 08 01:17:39 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:40 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-efe02e37-2452-4726-b099-86f9194b05b4 1073741824" returned: 0 in 0.974s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-efe02e37-2452-4726-b099-86f9194b05b4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:40 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-efe02e37-2452-4726-b099-86f9194b05b4 Jul 08 01:17:40 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:40 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_71ckk0fxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9" returned: 0 in 2.141s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:40 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_71ckk0fxdevstack@QuobyteHD, size 112.00 MB, duration 2.14 sec, destination /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9 {{(pid=87022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:17:40 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Converted 112.00 MB image at 52.30 MB/s Jul 08 01:17:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:40 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9 1G Jul 08 01:17:40 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:40 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-efe02e37-2452-4726-b099-86f9194b05b4" returned: 0 in 0.741s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:40 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:17:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46cb9359-b7f1-4f12-b3be-49ad8ed3f227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efe02e37-2452-4726-b099-86f9194b05b4', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ec235f3-88e3-4f61-abbc-3f7ff6fa8914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:40 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Volume volume-efe02e37-2452-4726-b099-86f9194b05b4 (efe02e37-2452-4726-b099-86f9194b05b4): created successfully Jul 08 01:17:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ec235f3-88e3-4f61-abbc-3f7ff6fa8914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Flow 'volume_create_manager' (9770454b-6fd4-4105-89f6-96bb30f0a860) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:17:40 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-74d3b21f-626c-4e10-b00f-aa337ad9aea9 tempest-VolumesTransfersV357Test-1771375383 None] Created volume successfully. Jul 08 01:17:41 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9 1G" returned: 0 in 0.731s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:41 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4263e63-4e96-4fc1-8f67-52b962d5925d]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:17:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:41 devstack sudo[98154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9 Jul 08 01:17:41 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:41 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-94f889b2-9475-4519-b9ce-18fcdede48c2 tempest-VolumesTransfersV357Test-433431962 None] Transfer volume completed successfully. Jul 08 01:17:42 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9" returned: 0 in 0.791s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:42 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9 Jul 08 01:17:42 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a7d780ea-d79e-4ae0-b008-b312414b1417 tempest-VolumesTransfersV357Test-986676765 None] Acquiring lock "cinder-efe02e37-2452-4726-b099-86f9194b05b4-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:17:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a7d780ea-d79e-4ae0-b008-b312414b1417 tempest-VolumesTransfersV357Test-986676765 None] Lock "cinder-efe02e37-2452-4726-b099-86f9194b05b4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:17:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a7d780ea-d79e-4ae0-b008-b312414b1417 tempest-VolumesTransfersV357Test-986676765 None] Acquiring lock "cinder-quobyte-efe02e37-2452-4726-b099-86f9194b05b4" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:17:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a7d780ea-d79e-4ae0-b008-b312414b1417 tempest-VolumesTransfersV357Test-986676765 None] Lock "cinder-quobyte-efe02e37-2452-4726-b099-86f9194b05b4" acquired by "delete_volume" :: waited 0.020s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:17:42 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f38da7-54ee-49b6-b8c6-43c7d3de082e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:17:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a7d780ea-d79e-4ae0-b008-b312414b1417 tempest-VolumesTransfersV357Test-986676765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-efe02e37-2452-4726-b099-86f9194b05b4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:43 devstack sudo[98163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-efe02e37-2452-4726-b099-86f9194b05b4 Jul 08 01:17:43 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:43 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9" returned: 1 in 0.873s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:17:43 devstack cinder-volume[87022]: DEBUG cinder.volume.volume_utils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Downloaded image f4d67a52-db18-4750-abc4-5b7335c6e867 ((None, [{'url': 'file:///opt/stack/data/glance/images/f4d67a52-db18-4750-abc4-5b7335c6e867', 'metadata': {}}])) to volume d785833b-71de-44af-af85-88af3e43b4a9 successfully. {{(pid=87022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:17:43 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Temporary image f4d67a52-db18-4750-abc4-5b7335c6e867 for user be79671ce36445a3a7abfb1c95648f1c is deleted. {{(pid=87022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:17:43 devstack cinder-volume[87022]: DEBUG cinder.volume.volume_utils [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Marking volume d785833b-71de-44af-af85-88af3e43b4a9 as bootable. {{(pid=87022) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:17:43 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Copying metadata from image f4d67a52-db18-4750-abc4-5b7335c6e867 to d785833b-71de-44af-af85-88af3e43b4a9. {{(pid=87022) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:17:43 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Creating volume glance metadata for volume d785833b-71de-44af-af85-88af3e43b4a9 backed by image f4d67a52-db18-4750-abc4-5b7335c6e867 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f4d67a52-db18-4750-abc4-5b7335c6e867', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87022) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:17:43 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c90198f-9849-48a0-9ebb-2b69c4bcca9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d785833b-71de-44af-af85-88af3e43b4a9', 'volume_size': 1, 'image_id': 'f4d67a52-db18-4750-abc4-5b7335c6e867', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4d67a52-db18-4750-abc4-5b7335c6e867', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81fea2dfa47f49cba26ad62301512b69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4d67a52-db18-4750-abc4-5b7335c6e867', 'created_at': datetime.datetime(2026, 7, 7, 22, 58, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 22, 58, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4d67a52-db18-4750-abc4-5b7335c6e867/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:43 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da3bc634-a75d-4742-80e5-81593d1270f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:43 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Volume volume-d785833b-71de-44af-af85-88af3e43b4a9 (d785833b-71de-44af-af85-88af3e43b4a9): created successfully Jul 08 01:17:43 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da3bc634-a75d-4742-80e5-81593d1270f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:43 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Flow 'volume_create_manager' (7deaacce-1289-42be-a454-e196701fdb10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:17:43 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-076c0c63-b1bf-49cf-a160-06b3ef53ae6b tempest-VolumesGetTest-438911491 None] Created volume successfully. Jul 08 01:17:43 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a7d780ea-d79e-4ae0-b008-b312414b1417 tempest-VolumesTransfersV357Test-986676765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-efe02e37-2452-4726-b099-86f9194b05b4" returned: 0 in 0.813s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a7d780ea-d79e-4ae0-b008-b312414b1417 tempest-VolumesTransfersV357Test-986676765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-efe02e37-2452-4726-b099-86f9194b05b4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:43 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-efe02e37-2452-4726-b099-86f9194b05b4 Jul 08 01:17:43 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Flow 'volume_create_manager' (b084aff1-3129-4b20-8207-82b103c8347b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70030fc3-4523-4140-8d11-a42f844f8cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70030fc3-4523-4140-8d11-a42f844f8cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:17:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1330423684',display_name='tempest-VolumesGetTest-Volume-1810992093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5b8489-e8fe-419e-8a01-ac372497a60a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac54fcd394484815b85bd40e4fd6c64a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:17:44Z,use_quota=True,user_id='be79671ce36445a3a7abfb1c95648f1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f31017dd-1c5c-4bda-acf1-dfa7111030e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f31017dd-1c5c-4bda-acf1-dfa7111030e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bdf38a1-17d6-40f1-bdde-b5a56354a829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bdf38a1-17d6-40f1-bdde-b5a56354a829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae5b8489-e8fe-419e-8a01-ac372497a60a', 'volume_name': 'volume-ae5b8489-e8fe-419e-8a01-ac372497a60a', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:44 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2831087f-15c3-427a-83d8-35ac941f2859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2831087f-15c3-427a-83d8-35ac941f2859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (396580bc-173e-4a0c-b3c2-3689a1c8f71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:44 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Volume ae5b8489-e8fe-419e-8a01-ac372497a60a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae5b8489-e8fe-419e-8a01-ac372497a60a', 'volume_size': 1} Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:17:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1330423684',display_name='tempest-VolumesGetTest-Volume-1810992093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5b8489-e8fe-419e-8a01-ac372497a60a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac54fcd394484815b85bd40e4fd6c64a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:17:44Z,use_quota=True,user_id='be79671ce36445a3a7abfb1c95648f1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Creating volume ae5b8489-e8fe-419e-8a01-ac372497a60a {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:17:44 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ae5b8489-e8fe-419e-8a01-ac372497a60a 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a7d780ea-d79e-4ae0-b008-b312414b1417 tempest-VolumesTransfersV357Test-986676765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-efe02e37-2452-4726-b099-86f9194b05b4" returned: 0 in 0.705s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:44 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ae5b8489-e8fe-419e-8a01-ac372497a60a 1073741824 Jul 08 01:17:44 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a7d780ea-d79e-4ae0-b008-b312414b1417 tempest-VolumesTransfersV357Test-986676765 None] Lock "cinder-quobyte-efe02e37-2452-4726-b099-86f9194b05b4" released by "delete_volume" :: held 1.569s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-a7d780ea-d79e-4ae0-b008-b312414b1417 tempest-VolumesTransfersV357Test-986676765 None] Created reservations ['9181a82c-d002-4b46-aab4-f3a60e84e967', 'b39119fc-8c97-4a15-89f8-282600b97305', '6ff621f3-a397-47c5-b565-b5a389cf7005', '3de6c0b1-a121-40c3-a1bc-f290e0e23e1b'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a7d780ea-d79e-4ae0-b008-b312414b1417 tempest-VolumesTransfersV357Test-986676765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a7d780ea-d79e-4ae0-b008-b312414b1417 tempest-VolumesTransfersV357Test-986676765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a7d780ea-d79e-4ae0-b008-b312414b1417 tempest-VolumesTransfersV357Test-986676765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a7d780ea-d79e-4ae0-b008-b312414b1417 tempest-VolumesTransfersV357Test-986676765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a7d780ea-d79e-4ae0-b008-b312414b1417 tempest-VolumesTransfersV357Test-986676765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a7d780ea-d79e-4ae0-b008-b312414b1417 tempest-VolumesTransfersV357Test-986676765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:44 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:17:44 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:45 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a7d780ea-d79e-4ae0-b008-b312414b1417 tempest-VolumesTransfersV357Test-986676765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.701s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:45 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-a7d780ea-d79e-4ae0-b008-b312414b1417 tempest-VolumesTransfersV357Test-986676765 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:17:45 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-a7d780ea-d79e-4ae0-b008-b312414b1417 tempest-VolumesTransfersV357Test-986676765 None] Deleted volume successfully. Jul 08 01:17:45 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a7d780ea-d79e-4ae0-b008-b312414b1417 tempest-VolumesTransfersV357Test-986676765 None] Lock "cinder-efe02e37-2452-4726-b099-86f9194b05b4-delete_volume" released by "delete_volume" :: held 2.518s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:17:45 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:17:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:17:45 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:17:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ae5b8489-e8fe-419e-8a01-ac372497a60a 1073741824" returned: 0 in 0.949s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:45 devstack sudo[98183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:17:45 devstack sudo[98183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ae5b8489-e8fe-419e-8a01-ac372497a60a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:45 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ae5b8489-e8fe-419e-8a01-ac372497a60a Jul 08 01:17:45 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:45 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:17:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Flow 'volume_create_manager' (5c74c5c1-1b0f-4b61-9d54-47bb9d19ebb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:17:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d328308-1fdc-4de4-a3bc-ac9c8564f504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d328308-1fdc-4de4-a3bc-ac9c8564f504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1733767082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94d257c-4fe3-430b-b14b-aabe5416d0e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f677cfc0a60d47e7904b1d650ade10dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:17:46Z,use_quota=True,user_id='a02d5b0c82784194a84ce2f7e49bd1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e30b5908-ecad-416a-9de8-06df9ce58f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e30b5908-ecad-416a-9de8-06df9ce58f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9937d280-63ae-4311-be05-04f4212bcc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9937d280-63ae-4311-be05-04f4212bcc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b94d257c-4fe3-430b-b14b-aabe5416d0e2', 'volume_name': 'volume-b94d257c-4fe3-430b-b14b-aabe5416d0e2', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b157edf-67c4-4b71-991e-ccb466826103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b157edf-67c4-4b71-991e-ccb466826103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6367d16-e77f-460a-bfe0-46845362ce05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:45 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Volume b94d257c-4fe3-430b-b14b-aabe5416d0e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b94d257c-4fe3-430b-b14b-aabe5416d0e2', 'volume_size': 1} Jul 08 01:17:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:46 devstack sudo[98183]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.710s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:46 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:17:46 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:17:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread count: 28 {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:17:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread info: [<_MainThread(MainThread, started 134382216167552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:17:46 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ae5b8489-e8fe-419e-8a01-ac372497a60a" returned: 0 in 0.680s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:46 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:17:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.324s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:46 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1733767082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94d257c-4fe3-430b-b14b-aabe5416d0e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f677cfc0a60d47e7904b1d650ade10dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:17:46Z,use_quota=True,user_id='a02d5b0c82784194a84ce2f7e49bd1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:17:46 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Creating volume b94d257c-4fe3-430b-b14b-aabe5416d0e2 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:17:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:46 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:17:46 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:17:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:46 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:17:46 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:17:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b94d257c-4fe3-430b-b14b-aabe5416d0e2 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:46 devstack sudo[98189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b94d257c-4fe3-430b-b14b-aabe5416d0e2 1073741824 Jul 08 01:17:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (396580bc-173e-4a0c-b3c2-3689a1c8f71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae5b8489-e8fe-419e-8a01-ac372497a60a', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:46 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c609e72a-6e33-4b88-b8fd-564f340d7814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:46 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Volume volume-ae5b8489-e8fe-419e-8a01-ac372497a60a (ae5b8489-e8fe-419e-8a01-ac372497a60a): created successfully Jul 08 01:17:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c609e72a-6e33-4b88-b8fd-564f340d7814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Flow 'volume_create_manager' (b084aff1-3129-4b20-8207-82b103c8347b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:17:46 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-a1e29535-d38d-44eb-a906-a93af2f78b9f tempest-VolumesGetTest-438911491 None] Created volume successfully. Jul 08 01:17:46 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-586262b6-632f-4f32-870b-0ae95e4b01a4 tempest-VolumesGetTest-438911491 None] Acquiring lock "cinder-ae5b8489-e8fe-419e-8a01-ac372497a60a-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:17:46 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-586262b6-632f-4f32-870b-0ae95e4b01a4 tempest-VolumesGetTest-438911491 None] Lock "cinder-ae5b8489-e8fe-419e-8a01-ac372497a60a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:17:46 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-586262b6-632f-4f32-870b-0ae95e4b01a4 tempest-VolumesGetTest-438911491 None] Acquiring lock "cinder-quobyte-ae5b8489-e8fe-419e-8a01-ac372497a60a" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:17:46 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-586262b6-632f-4f32-870b-0ae95e4b01a4 tempest-VolumesGetTest-438911491 None] Lock "cinder-quobyte-ae5b8489-e8fe-419e-8a01-ac372497a60a" acquired by "delete_volume" :: waited 0.014s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:17:46 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de19962-deda-4481-ab41-2519a7ce7bb4]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:17:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-586262b6-632f-4f32-870b-0ae95e4b01a4 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ae5b8489-e8fe-419e-8a01-ac372497a60a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:46 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ae5b8489-e8fe-419e-8a01-ac372497a60a Jul 08 01:17:46 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:47 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b94d257c-4fe3-430b-b14b-aabe5416d0e2 1073741824" returned: 0 in 0.941s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b94d257c-4fe3-430b-b14b-aabe5416d0e2 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:47 devstack sudo[98197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b94d257c-4fe3-430b-b14b-aabe5416d0e2 Jul 08 01:17:47 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:47 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-586262b6-632f-4f32-870b-0ae95e4b01a4 tempest-VolumesGetTest-438911491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ae5b8489-e8fe-419e-8a01-ac372497a60a" returned: 0 in 0.857s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-586262b6-632f-4f32-870b-0ae95e4b01a4 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ae5b8489-e8fe-419e-8a01-ac372497a60a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:47 devstack sudo[98204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ae5b8489-e8fe-419e-8a01-ac372497a60a Jul 08 01:17:47 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:47 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b94d257c-4fe3-430b-b14b-aabe5416d0e2" returned: 0 in 0.858s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:47 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:17:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:48 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6367d16-e77f-460a-bfe0-46845362ce05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b94d257c-4fe3-430b-b14b-aabe5416d0e2', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:48 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7967a503-72e4-49a9-8059-cedafdc7a06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:48 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Volume volume-b94d257c-4fe3-430b-b14b-aabe5416d0e2 (b94d257c-4fe3-430b-b14b-aabe5416d0e2): created successfully Jul 08 01:17:48 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7967a503-72e4-49a9-8059-cedafdc7a06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:48 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Flow 'volume_create_manager' (5c74c5c1-1b0f-4b61-9d54-47bb9d19ebb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:17:48 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-fcaad63d-e1ba-4680-b79c-f14d999c5e29 tempest-VolumesTransfersV357Test-1771375383 None] Created volume successfully. Jul 08 01:17:48 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-586262b6-632f-4f32-870b-0ae95e4b01a4 tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ae5b8489-e8fe-419e-8a01-ac372497a60a" returned: 0 in 0.766s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:48 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-586262b6-632f-4f32-870b-0ae95e4b01a4 tempest-VolumesGetTest-438911491 None] Lock "cinder-quobyte-ae5b8489-e8fe-419e-8a01-ac372497a60a" released by "delete_volume" :: held 1.668s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:17:48 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-586262b6-632f-4f32-870b-0ae95e4b01a4 tempest-VolumesGetTest-438911491 None] Created reservations ['768251cb-9845-4dbf-a89b-3917492916ef', '27d486f5-0e36-4dc1-b8f5-4d92359740d0', 'dfd6ba3d-ec2e-4794-98df-92be19f8f504', '4453a21a-c7e8-478e-8917-f53318faa3ac'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:17:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-586262b6-632f-4f32-870b-0ae95e4b01a4 tempest-VolumesGetTest-438911491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-586262b6-632f-4f32-870b-0ae95e4b01a4 tempest-VolumesGetTest-438911491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:48 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-586262b6-632f-4f32-870b-0ae95e4b01a4 tempest-VolumesGetTest-438911491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:17:48 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-586262b6-632f-4f32-870b-0ae95e4b01a4 tempest-VolumesGetTest-438911491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:17:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-586262b6-632f-4f32-870b-0ae95e4b01a4 tempest-VolumesGetTest-438911491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-586262b6-632f-4f32-870b-0ae95e4b01a4 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:48 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:17:48 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:49 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8fdc248a-a831-4de6-b6bd-18a646fe7498 tempest-VolumesGetTest-438911491 None] Acquiring lock "cinder-d785833b-71de-44af-af85-88af3e43b4a9-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:17:49 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8fdc248a-a831-4de6-b6bd-18a646fe7498 tempest-VolumesGetTest-438911491 None] Lock "cinder-d785833b-71de-44af-af85-88af3e43b4a9-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:17:49 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8fdc248a-a831-4de6-b6bd-18a646fe7498 tempest-VolumesGetTest-438911491 None] Acquiring lock "cinder-quobyte-d785833b-71de-44af-af85-88af3e43b4a9" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:17:49 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8fdc248a-a831-4de6-b6bd-18a646fe7498 tempest-VolumesGetTest-438911491 None] Lock "cinder-quobyte-d785833b-71de-44af-af85-88af3e43b4a9" acquired by "delete_volume" :: waited 0.027s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:17:49 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[5790e06a-8a20-434d-b059-3bdfacd5b8b5]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:17:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8fdc248a-a831-4de6-b6bd-18a646fe7498 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:49 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-586262b6-632f-4f32-870b-0ae95e4b01a4 tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.867s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:49 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-586262b6-632f-4f32-870b-0ae95e4b01a4 tempest-VolumesGetTest-438911491 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:17:49 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-586262b6-632f-4f32-870b-0ae95e4b01a4 tempest-VolumesGetTest-438911491 None] Deleted volume successfully. Jul 08 01:17:49 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-586262b6-632f-4f32-870b-0ae95e4b01a4 tempest-VolumesGetTest-438911491 None] Lock "cinder-ae5b8489-e8fe-419e-8a01-ac372497a60a-delete_volume" released by "delete_volume" :: held 2.800s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:17:49 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1939a981-f30e-47b9-8d59-974d4331d73e tempest-VolumesTransfersV357Test-986676765 None] Acquiring lock "cinder-b94d257c-4fe3-430b-b14b-aabe5416d0e2-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:17:49 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9 Jul 08 01:17:49 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:49 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1939a981-f30e-47b9-8d59-974d4331d73e tempest-VolumesTransfersV357Test-986676765 None] Lock "cinder-b94d257c-4fe3-430b-b14b-aabe5416d0e2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:17:49 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1939a981-f30e-47b9-8d59-974d4331d73e tempest-VolumesTransfersV357Test-986676765 None] Acquiring lock "cinder-quobyte-b94d257c-4fe3-430b-b14b-aabe5416d0e2" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:17:49 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1939a981-f30e-47b9-8d59-974d4331d73e tempest-VolumesTransfersV357Test-986676765 None] Lock "cinder-quobyte-b94d257c-4fe3-430b-b14b-aabe5416d0e2" acquired by "delete_volume" :: waited 0.038s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:17:49 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f723904-3bd9-430d-9312-11d346062c11]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:17:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1939a981-f30e-47b9-8d59-974d4331d73e tempest-VolumesTransfersV357Test-986676765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b94d257c-4fe3-430b-b14b-aabe5416d0e2 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:49 devstack sudo[98228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b94d257c-4fe3-430b-b14b-aabe5416d0e2 Jul 08 01:17:49 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:50 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8fdc248a-a831-4de6-b6bd-18a646fe7498 tempest-VolumesGetTest-438911491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9" returned: 0 in 0.934s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8fdc248a-a831-4de6-b6bd-18a646fe7498 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:50 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9 Jul 08 01:17:50 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:50 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1939a981-f30e-47b9-8d59-974d4331d73e tempest-VolumesTransfersV357Test-986676765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b94d257c-4fe3-430b-b14b-aabe5416d0e2" returned: 0 in 0.927s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1939a981-f30e-47b9-8d59-974d4331d73e tempest-VolumesTransfersV357Test-986676765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b94d257c-4fe3-430b-b14b-aabe5416d0e2 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:50 devstack sudo[98245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b94d257c-4fe3-430b-b14b-aabe5416d0e2 Jul 08 01:17:50 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:51 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8fdc248a-a831-4de6-b6bd-18a646fe7498 tempest-VolumesGetTest-438911491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9" returned: 1 in 0.867s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8fdc248a-a831-4de6-b6bd-18a646fe7498 tempest-VolumesGetTest-438911491 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:17:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8fdc248a-a831-4de6-b6bd-18a646fe7498 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:51 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9 Jul 08 01:17:51 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:51 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1939a981-f30e-47b9-8d59-974d4331d73e tempest-VolumesTransfersV357Test-986676765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b94d257c-4fe3-430b-b14b-aabe5416d0e2" returned: 0 in 0.892s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:51 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1939a981-f30e-47b9-8d59-974d4331d73e tempest-VolumesTransfersV357Test-986676765 None] Lock "cinder-quobyte-b94d257c-4fe3-430b-b14b-aabe5416d0e2" released by "delete_volume" :: held 1.883s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:17:51 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-1939a981-f30e-47b9-8d59-974d4331d73e tempest-VolumesTransfersV357Test-986676765 None] Created reservations ['d472ffa8-b51b-4731-a42b-4ee5c71fef07', '01c74e60-e92a-4473-936b-499adf9441a5', 'e1033b96-2739-48c0-9990-fa9960eca041', '487c62fa-2563-407a-8fdb-abe1ae00d645'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:17:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1939a981-f30e-47b9-8d59-974d4331d73e tempest-VolumesTransfersV357Test-986676765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1939a981-f30e-47b9-8d59-974d4331d73e tempest-VolumesTransfersV357Test-986676765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:51 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1939a981-f30e-47b9-8d59-974d4331d73e tempest-VolumesTransfersV357Test-986676765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:17:51 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1939a981-f30e-47b9-8d59-974d4331d73e tempest-VolumesTransfersV357Test-986676765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:17:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1939a981-f30e-47b9-8d59-974d4331d73e tempest-VolumesTransfersV357Test-986676765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1939a981-f30e-47b9-8d59-974d4331d73e tempest-VolumesTransfersV357Test-986676765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:51 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:17:51 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:51 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8fdc248a-a831-4de6-b6bd-18a646fe7498 tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d785833b-71de-44af-af85-88af3e43b4a9" returned: 0 in 0.865s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:51 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8fdc248a-a831-4de6-b6bd-18a646fe7498 tempest-VolumesGetTest-438911491 None] Lock "cinder-quobyte-d785833b-71de-44af-af85-88af3e43b4a9" released by "delete_volume" :: held 2.778s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:17:52 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-8fdc248a-a831-4de6-b6bd-18a646fe7498 tempest-VolumesGetTest-438911491 None] Created reservations ['5ae9063a-3f21-46c1-942a-5ca17f2e2beb', 'bc9c9b92-de89-4d45-b499-5db457fc9427', '2ae93148-16ab-43af-b561-a5490c618560', 'd93a1260-c817-47a1-954a-f2977f2a9346'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:17:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8fdc248a-a831-4de6-b6bd-18a646fe7498 tempest-VolumesGetTest-438911491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8fdc248a-a831-4de6-b6bd-18a646fe7498 tempest-VolumesGetTest-438911491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8fdc248a-a831-4de6-b6bd-18a646fe7498 tempest-VolumesGetTest-438911491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:17:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8fdc248a-a831-4de6-b6bd-18a646fe7498 tempest-VolumesGetTest-438911491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:17:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8fdc248a-a831-4de6-b6bd-18a646fe7498 tempest-VolumesGetTest-438911491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8fdc248a-a831-4de6-b6bd-18a646fe7498 tempest-VolumesGetTest-438911491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:52 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:17:52 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:52 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1939a981-f30e-47b9-8d59-974d4331d73e tempest-VolumesTransfersV357Test-986676765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.253s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:52 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-1939a981-f30e-47b9-8d59-974d4331d73e tempest-VolumesTransfersV357Test-986676765 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:17:52 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-1939a981-f30e-47b9-8d59-974d4331d73e tempest-VolumesTransfersV357Test-986676765 None] Deleted volume successfully. Jul 08 01:17:52 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1939a981-f30e-47b9-8d59-974d4331d73e tempest-VolumesTransfersV357Test-986676765 None] Lock "cinder-b94d257c-4fe3-430b-b14b-aabe5416d0e2-delete_volume" released by "delete_volume" :: held 3.524s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:17:53 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8fdc248a-a831-4de6-b6bd-18a646fe7498 tempest-VolumesGetTest-438911491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.054s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:53 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-8fdc248a-a831-4de6-b6bd-18a646fe7498 tempest-VolumesGetTest-438911491 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:17:53 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-8fdc248a-a831-4de6-b6bd-18a646fe7498 tempest-VolumesGetTest-438911491 None] Deleted volume successfully. Jul 08 01:17:53 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8fdc248a-a831-4de6-b6bd-18a646fe7498 tempest-VolumesGetTest-438911491 None] Lock "cinder-d785833b-71de-44af-af85-88af3e43b4a9-delete_volume" released by "delete_volume" :: held 4.274s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:17:53 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-b6ac147e-522a-4314-9730-87370a9770b5 req-69d05be7-37d5-40fb-bf9f-da0bd73af37a tempest-TestMinimumBasicScenario-1357285902 None] Terminate volume connection completed successfully. Jul 08 01:17:53 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-b6ac147e-522a-4314-9730-87370a9770b5 req-69d05be7-37d5-40fb-bf9f-da0bd73af37a tempest-TestMinimumBasicScenario-1357285902 None] Deleting attachment 44698c94-cbe1-4e6c-b3a6-d8120d94457e. {{(pid=87022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:17:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c4818d51-b46a-4033-9610-99a52129fd09 tempest-TestMinimumBasicScenario-1357285902 None] Acquiring lock "cinder-1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:17:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c4818d51-b46a-4033-9610-99a52129fd09 tempest-TestMinimumBasicScenario-1357285902 None] Lock "cinder-1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:17:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c4818d51-b46a-4033-9610-99a52129fd09 tempest-TestMinimumBasicScenario-1357285902 None] Acquiring lock "cinder-quobyte-1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:17:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c4818d51-b46a-4033-9610-99a52129fd09 tempest-TestMinimumBasicScenario-1357285902 None] Lock "cinder-quobyte-1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9" acquired by "delete_volume" :: waited 0.028s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:17:56 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d669f68-de65-4dec-af0e-50d6bcf7e6fa]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:17:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c4818d51-b46a-4033-9610-99a52129fd09 tempest-TestMinimumBasicScenario-1357285902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:56 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9 Jul 08 01:17:56 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:57 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c4818d51-b46a-4033-9610-99a52129fd09 tempest-TestMinimumBasicScenario-1357285902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9" returned: 0 in 1.478s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c4818d51-b46a-4033-9610-99a52129fd09 tempest-TestMinimumBasicScenario-1357285902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:57 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9 Jul 08 01:17:57 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:58 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:17:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Flow 'volume_create_manager' (5a113406-e755-4192-8ef1-f7011d5640a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:17:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df2776c4-92df-4efd-b6ef-11d6a1e851bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df2776c4-92df-4efd-b6ef-11d6a1e851bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1370519831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb67a4d8-bb65-48a0-b529-7f2a37d0e6c2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='675b6b2393304a58aea20547120ce2ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:17:58Z,use_quota=True,user_id='2d0adfaa93514a63a9aadb3ca7b490a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a244e4-1381-4f59-a5f2-91962099f904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a244e4-1381-4f59-a5f2-91962099f904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21655f1b-4c48-48bd-8b42-bba1e74e67f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21655f1b-4c48-48bd-8b42-bba1e74e67f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb67a4d8-bb65-48a0-b529-7f2a37d0e6c2', 'volume_name': 'volume-fb67a4d8-bb65-48a0-b529-7f2a37d0e6c2', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3347f9ab-afbc-4503-b641-53311ab1ccf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3347f9ab-afbc-4503-b641-53311ab1ccf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1192405-499a-44ad-a4b4-3a86ba971fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:58 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Volume fb67a4d8-bb65-48a0-b529-7f2a37d0e6c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb67a4d8-bb65-48a0-b529-7f2a37d0e6c2', 'volume_size': 1} Jul 08 01:17:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1370519831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb67a4d8-bb65-48a0-b529-7f2a37d0e6c2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='675b6b2393304a58aea20547120ce2ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:17:58Z,use_quota=True,user_id='2d0adfaa93514a63a9aadb3ca7b490a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:17:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Creating volume fb67a4d8-bb65-48a0-b529-7f2a37d0e6c2 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:17:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:17:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:17:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:17:58 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:17:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb67a4d8-bb65-48a0-b529-7f2a37d0e6c2 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:58 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb67a4d8-bb65-48a0-b529-7f2a37d0e6c2 1073741824 Jul 08 01:17:58 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-be5f9f3d-7b48-4ebe-86d2-82e6e5b26ae0 tempest-VolumesActionsTest-1673967414 None] Acquiring lock "cinder-63661f0e-c7fe-4b7d-9588-c5e433b0b45e" by "attach_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:17:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-be5f9f3d-7b48-4ebe-86d2-82e6e5b26ae0 tempest-VolumesActionsTest-1673967414 None] Lock "cinder-63661f0e-c7fe-4b7d-9588-c5e433b0b45e" acquired by "attach_volume" :: waited 0.044s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:17:58 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c4818d51-b46a-4033-9610-99a52129fd09 tempest-TestMinimumBasicScenario-1357285902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9" returned: 0 in 1.261s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c4818d51-b46a-4033-9610-99a52129fd09 tempest-TestMinimumBasicScenario-1357285902 None] Lock "cinder-quobyte-1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9" released by "delete_volume" :: held 2.820s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:17:59 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-be5f9f3d-7b48-4ebe-86d2-82e6e5b26ae0 tempest-VolumesActionsTest-1673967414 None] Attaching volume 63661f0e-c7fe-4b7d-9588-c5e433b0b45e to instance 451d7144-b6ef-4c7e-9b87-b300cce2e165 at mountpoint /dev/vdb on host None. Jul 08 01:17:59 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-be5f9f3d-7b48-4ebe-86d2-82e6e5b26ae0 tempest-VolumesActionsTest-1673967414 None] Attach volume completed successfully. Jul 08 01:17:59 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-c4818d51-b46a-4033-9610-99a52129fd09 tempest-TestMinimumBasicScenario-1357285902 None] Created reservations ['4357d35b-ffcb-4acf-8e7e-1db663f19a66', '903b038e-59a2-429d-bb59-b3d52c4e3001', '234ddb03-2d40-435d-a514-da04ee58bc92', '510976d1-70fe-4258-9d9c-53d4d20e30ee'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:17:59 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-be5f9f3d-7b48-4ebe-86d2-82e6e5b26ae0 tempest-VolumesActionsTest-1673967414 None] Lock "cinder-63661f0e-c7fe-4b7d-9588-c5e433b0b45e" released by "attach_volume" :: held 0.243s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:17:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c4818d51-b46a-4033-9610-99a52129fd09 tempest-TestMinimumBasicScenario-1357285902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c4818d51-b46a-4033-9610-99a52129fd09 tempest-TestMinimumBasicScenario-1357285902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c4818d51-b46a-4033-9610-99a52129fd09 tempest-TestMinimumBasicScenario-1357285902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:17:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c4818d51-b46a-4033-9610-99a52129fd09 tempest-TestMinimumBasicScenario-1357285902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:17:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c4818d51-b46a-4033-9610-99a52129fd09 tempest-TestMinimumBasicScenario-1357285902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c4818d51-b46a-4033-9610-99a52129fd09 tempest-TestMinimumBasicScenario-1357285902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:59 devstack sudo[98346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:17:59 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:59 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-75aa03e8-eea3-4c33-b3db-8a83b3243276 tempest-VolumesActionsTest-1673967414 None] Acquiring lock "cinder-63661f0e-c7fe-4b7d-9588-c5e433b0b45e-detach_volume" by "detach_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:17:59 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-75aa03e8-eea3-4c33-b3db-8a83b3243276 tempest-VolumesActionsTest-1673967414 None] Lock "cinder-63661f0e-c7fe-4b7d-9588-c5e433b0b45e-detach_volume" acquired by "detach_volume" :: waited 0.048s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:17:59 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-75aa03e8-eea3-4c33-b3db-8a83b3243276 tempest-VolumesActionsTest-1673967414 None] Detaching volume 63661f0e-c7fe-4b7d-9588-c5e433b0b45e from instance 451d7144-b6ef-4c7e-9b87-b300cce2e165. Jul 08 01:17:59 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-75aa03e8-eea3-4c33-b3db-8a83b3243276 tempest-VolumesActionsTest-1673967414 None] Detach volume completed successfully. Jul 08 01:17:59 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-75aa03e8-eea3-4c33-b3db-8a83b3243276 tempest-VolumesActionsTest-1673967414 None] Lock "cinder-63661f0e-c7fe-4b7d-9588-c5e433b0b45e-detach_volume" released by "detach_volume" :: held 0.165s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:18:00 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb67a4d8-bb65-48a0-b529-7f2a37d0e6c2 1073741824" returned: 0 in 1.798s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb67a4d8-bb65-48a0-b529-7f2a37d0e6c2 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:00 devstack sudo[98352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb67a4d8-bb65-48a0-b529-7f2a37d0e6c2 Jul 08 01:18:00 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:00 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c4818d51-b46a-4033-9610-99a52129fd09 tempest-TestMinimumBasicScenario-1357285902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.436s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:00 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-c4818d51-b46a-4033-9610-99a52129fd09 tempest-TestMinimumBasicScenario-1357285902 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:18:00 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-c4818d51-b46a-4033-9610-99a52129fd09 tempest-TestMinimumBasicScenario-1357285902 None] Deleted volume successfully. Jul 08 01:18:00 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c4818d51-b46a-4033-9610-99a52129fd09 tempest-TestMinimumBasicScenario-1357285902 None] Lock "cinder-1f3e7df5-3a3e-4bb0-80f7-c4add872fbf9-delete_volume" released by "delete_volume" :: held 4.640s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:18:01 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb67a4d8-bb65-48a0-b529-7f2a37d0e6c2" returned: 0 in 0.880s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] <== create_volume: return (2748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:18:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.752s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:18:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1192405-499a-44ad-a4b4-3a86ba971fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb67a4d8-bb65-48a0-b529-7f2a37d0e6c2', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69aa1a7f-f5d0-44a2-9987-550b938f0bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:01 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Volume volume-fb67a4d8-bb65-48a0-b529-7f2a37d0e6c2 (fb67a4d8-bb65-48a0-b529-7f2a37d0e6c2): created successfully Jul 08 01:18:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69aa1a7f-f5d0-44a2-9987-550b938f0bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Flow 'volume_create_manager' (5a113406-e755-4192-8ef1-f7011d5640a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:18:01 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-84b4b94d-ff43-43d6-80cd-1147bbdf8168 tempest-VolumesListTestJSON-384817269 None] Created volume successfully. Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Flow 'volume_create_manager' (c3b14b75-9815-4f34-a8b7-94c6dcd59c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65706e8a-ed8f-404e-8f62-5e9c8175217f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65706e8a-ed8f-404e-8f62-5e9c8175217f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1417995333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a999bdc-85f0-4723-9a48-902947546e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ca1c64dc0c40fe921ced8f95d11d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:18:02Z,use_quota=True,user_id='857eb77ff60f44b98cade81ce5d74d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c537689-2650-4ea0-8871-33b053a568c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c537689-2650-4ea0-8871-33b053a568c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b8290b6-75d5-4d58-bf42-dbbba21376a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b8290b6-75d5-4d58-bf42-dbbba21376a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a999bdc-85f0-4723-9a48-902947546e57', 'volume_name': 'volume-2a999bdc-85f0-4723-9a48-902947546e57', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf16ad7-a393-41e2-824a-0c90eb6765bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf16ad7-a393-41e2-824a-0c90eb6765bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a86257fa-fa1e-4201-a9a4-a934626829c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:02 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Volume 2a999bdc-85f0-4723-9a48-902947546e57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a999bdc-85f0-4723-9a48-902947546e57', 'volume_size': 1} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1417995333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a999bdc-85f0-4723-9a48-902947546e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ca1c64dc0c40fe921ced8f95d11d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:18:02Z,use_quota=True,user_id='857eb77ff60f44b98cade81ce5d74d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Creating volume 2a999bdc-85f0-4723-9a48-902947546e57 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:18:02 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:02 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57 1073741824 Jul 08 01:18:02 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Flow 'volume_create_manager' (f0d36b43-56ba-4bb6-907d-07d91de48722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5de5c5f7-e1a2-4496-a58b-ce55450b18d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5de5c5f7-e1a2-4496-a58b-ce55450b18d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1460011303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=027c54d6-8c07-4826-bb56-3f189c360bf1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='675b6b2393304a58aea20547120ce2ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:18:02Z,use_quota=True,user_id='2d0adfaa93514a63a9aadb3ca7b490a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c1b4755-9a6a-4113-8b3f-691da2e6b546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c1b4755-9a6a-4113-8b3f-691da2e6b546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48ecfecf-199c-4080-bd25-263cd693d410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48ecfecf-199c-4080-bd25-263cd693d410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '027c54d6-8c07-4826-bb56-3f189c360bf1', 'volume_name': 'volume-027c54d6-8c07-4826-bb56-3f189c360bf1', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3449b13a-c9a6-4129-8d86-ffef5894f91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3449b13a-c9a6-4129-8d86-ffef5894f91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e48add9-37fa-4c53-922f-b9798eeb527a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:02 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Volume 027c54d6-8c07-4826-bb56-3f189c360bf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-027c54d6-8c07-4826-bb56-3f189c360bf1', 'volume_size': 1} Jul 08 01:18:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:18:03 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57 1073741824" returned: 0 in 1.250s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:03 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=87,cinder:UPDATE=123,cinder:DELETE=10,cinder:INSERT=39 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:18:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:03 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57 Jul 08 01:18:03 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:04 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57" returned: 0 in 0.748s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] <== create_volume: return (2075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:18:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.081s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:18:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.500s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:18:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1460011303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=027c54d6-8c07-4826-bb56-3f189c360bf1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='675b6b2393304a58aea20547120ce2ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:18:02Z,use_quota=True,user_id='2d0adfaa93514a63a9aadb3ca7b490a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:18:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Creating volume 027c54d6-8c07-4826-bb56-3f189c360bf1 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:18:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:18:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:18:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:18:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:18:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:18:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:18:04 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:18:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-027c54d6-8c07-4826-bb56-3f189c360bf1 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:04 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a86257fa-fa1e-4201-a9a4-a934626829c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a999bdc-85f0-4723-9a48-902947546e57', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:04 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-027c54d6-8c07-4826-bb56-3f189c360bf1 1073741824 Jul 08 01:18:04 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:04 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c8ba2d2-60f2-4828-afe0-cadb4d67ed89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:04 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Volume volume-2a999bdc-85f0-4723-9a48-902947546e57 (2a999bdc-85f0-4723-9a48-902947546e57): created successfully Jul 08 01:18:04 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c8ba2d2-60f2-4828-afe0-cadb4d67ed89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:04 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Flow 'volume_create_manager' (c3b14b75-9815-4f34-a8b7-94c6dcd59c81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:18:04 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-0bb0b94e-dcb6-483c-b2d8-8fa1864a2526 tempest-VolumesCloneTest-1423533524 None] Created volume successfully. Jul 08 01:18:05 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-027c54d6-8c07-4826-bb56-3f189c360bf1 1073741824" returned: 0 in 0.842s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-027c54d6-8c07-4826-bb56-3f189c360bf1 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:05 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-027c54d6-8c07-4826-bb56-3f189c360bf1 Jul 08 01:18:05 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:05 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:18:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Flow 'volume_create_manager' (884da7a0-5ec6-4302-a726-60954ac54e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:18:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (595f4bc7-d3bc-4d05-aa2d-6133827dee5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (595f4bc7-d3bc-4d05-aa2d-6133827dee5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1182861779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0762ee21-b8ef-4fd0-83bb-7be60968aaf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ca1c64dc0c40fe921ced8f95d11d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:18:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=2a999bdc-85f0-4723-9a48-902947546e57,status='creating',terminated_at=None,updated_at=2026-07-07T23:18:06Z,use_quota=True,user_id='857eb77ff60f44b98cade81ce5d74d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c808de95-43ac-428f-82ba-a13dcf66347b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c808de95-43ac-428f-82ba-a13dcf66347b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9468a4e-9988-47ae-8e61-f15f72197de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9468a4e-9988-47ae-8e61-f15f72197de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0762ee21-b8ef-4fd0-83bb-7be60968aaf6', 'volume_name': 'volume-0762ee21-b8ef-4fd0-83bb-7be60968aaf6', 'volume_size': 2, 'source_volid': '2a999bdc-85f0-4723-9a48-902947546e57', 'source_volstatus': 'available'}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dca68754-8890-4d0b-b435-d1ad0aca837a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dca68754-8890-4d0b-b435-d1ad0aca837a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ab0c7a-d1a9-4ed3-97f9-3baa96bd845e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:05 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Volume 0762ee21-b8ef-4fd0-83bb-7be60968aaf6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0762ee21-b8ef-4fd0-83bb-7be60968aaf6', 'volume_size': 2, 'source_volid': '2a999bdc-85f0-4723-9a48-902947546e57', 'source_volstatus': 'available'} Jul 08 01:18:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:18:05 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-027c54d6-8c07-4826-bb56-3f189c360bf1" returned: 0 in 0.750s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:05 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:18:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:18:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.017s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:18:05 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Cloning volume 2a999bdc-85f0-4723-9a48-902947546e57 to volume 0762ee21-b8ef-4fd0-83bb-7be60968aaf6 Jul 08 01:18:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e48add9-37fa-4c53-922f-b9798eeb527a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-027c54d6-8c07-4826-bb56-3f189c360bf1', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb1d4e05-85db-4f2d-bdce-375d266599a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:05 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Volume volume-027c54d6-8c07-4826-bb56-3f189c360bf1 (027c54d6-8c07-4826-bb56-3f189c360bf1): created successfully Jul 08 01:18:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb1d4e05-85db-4f2d-bdce-375d266599a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Flow 'volume_create_manager' (f0d36b43-56ba-4bb6-907d-07d91de48722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:18:05 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Creating offline snapshot 7c60c605-db88-47fd-a677-396d55f009b2 of volume 2a999bdc-85f0-4723-9a48-902947546e57 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:18:05 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-04ff0393-2158-4589-a826-516508b41a8a tempest-VolumesListTestJSON-384817269 None] Created volume successfully. Jul 08 01:18:05 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[114971b1-189e-431d-9088-97dd0c159597]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:18:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:06 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57 Jul 08 01:18:06 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:06 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57" returned: 0 in 0.853s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57.7c60c605-db88-47fd-a677-396d55f009b2 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:06 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57.7c60c605-db88-47fd-a677-396d55f009b2 1G Jul 08 01:18:06 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:07 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:18:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Flow 'volume_create_manager' (f257836f-bf04-406d-9126-f03a37b09d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:18:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d26a530-b041-49b4-b502-dde924643348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d26a530-b041-49b4-b502-dde924643348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1622113332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e86fe3d-4ac7-45b2-bf78-aa5ebd8300df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='675b6b2393304a58aea20547120ce2ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:18:07Z,use_quota=True,user_id='2d0adfaa93514a63a9aadb3ca7b490a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00c294a-46ba-4081-9ec3-e6387e18b7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00c294a-46ba-4081-9ec3-e6387e18b7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af57021-bce6-4c7e-960a-7f37d7b14469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af57021-bce6-4c7e-960a-7f37d7b14469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e86fe3d-4ac7-45b2-bf78-aa5ebd8300df', 'volume_name': 'volume-2e86fe3d-4ac7-45b2-bf78-aa5ebd8300df', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6daacf4-e2d3-4b12-b479-5b90833fc6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6daacf4-e2d3-4b12-b479-5b90833fc6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b0966dd-0280-4b8d-a583-def3b28ee7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:07 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Volume 2e86fe3d-4ac7-45b2-bf78-aa5ebd8300df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e86fe3d-4ac7-45b2-bf78-aa5ebd8300df', 'volume_size': 1} Jul 08 01:18:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:18:07 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57.7c60c605-db88-47fd-a677-396d55f009b2 1G" returned: 0 in 0.939s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a999bdc-85f0-4723-9a48-902947546e57 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57.7c60c605-db88-47fd-a677-396d55f009b2 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:07 devstack sudo[98430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a999bdc-85f0-4723-9a48-902947546e57 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57.7c60c605-db88-47fd-a677-396d55f009b2 Jul 08 01:18:07 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:08 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a999bdc-85f0-4723-9a48-902947546e57 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57.7c60c605-db88-47fd-a677-396d55f009b2" returned: 0 in 0.928s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:08 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57.7c60c605-db88-47fd-a677-396d55f009b2 is being set with open permissions: ugo+rw Jul 08 01:18:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57.7c60c605-db88-47fd-a677-396d55f009b2 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:08 devstack sudo[98473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57.7c60c605-db88-47fd-a677-396d55f009b2 Jul 08 01:18:08 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:09 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57.7c60c605-db88-47fd-a677-396d55f009b2" returned: 0 in 0.813s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:09 devstack sudo[98476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57.info Jul 08 01:18:09 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:10 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57.info" returned: 0 in 0.682s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:10 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57.info is being set with open permissions: ugo+rw Jul 08 01:18:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:10 devstack sudo[98480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57.info Jul 08 01:18:10 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-49602323-1a44-4e51-b5c0-5f92de21e739 tempest-VolumesActionsTest-1673967414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:18:10 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57.info" returned: 0 in 0.659s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:10 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Acquiring lock "cinder-quobyte-0762ee21-b8ef-4fd0-83bb-7be60968aaf6" by "_copy_volume_from_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:18:10 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Lock "cinder-quobyte-0762ee21-b8ef-4fd0-83bb-7be60968aaf6" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:18:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] snapshot: 7c60c605-db88-47fd-a677-396d55f009b2, volume: 0762ee21-b8ef-4fd0-83bb-7be60968aaf6, {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:18:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:18:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:18:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:18:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:18:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:18:10 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d13912-29e0-4760-81fa-03513c3bcb7d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:18:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57.7c60c605-db88-47fd-a677-396d55f009b2 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:11 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57.7c60c605-db88-47fd-a677-396d55f009b2 Jul 08 01:18:11 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:11 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57.7c60c605-db88-47fd-a677-396d55f009b2" returned: 0 in 0.876s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:11 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a999bdc-85f0-4723-9a48-902947546e57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:18:11 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] will copy from snapshot at /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57 {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:18:11 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Creating direct copy from snapshot {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:18:11 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d0b43f-cfe0-4f0a-9f06-8f5880c2fe59]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:18:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:11 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57 Jul 08 01:18:11 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:12 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57" returned: 0 in 0.843s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:12 devstack cinder-volume[87022]: DEBUG cinder.utils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Path /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0762ee21-b8ef-4fd0-83bb-7be60968aaf6 not found in is_blk_device check {{(pid=87022) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:18:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0762ee21-b8ef-4fd0-83bb-7be60968aaf6 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:12 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0762ee21-b8ef-4fd0-83bb-7be60968aaf6 Jul 08 01:18:12 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:18 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0762ee21-b8ef-4fd0-83bb-7be60968aaf6" returned: 0 in 5.508s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:18 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b3e550-e59d-443a-bf6e-b96b83af77ca]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:18:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:18 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57 Jul 08 01:18:18 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:19 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57" returned: 0 in 0.952s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:19 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Image conversion details: src /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57, size 1024.00 MB, duration 5.51 sec, destination /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0762ee21-b8ef-4fd0-83bb-7be60968aaf6 {{(pid=87022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:18:19 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Converted 1024.00 MB image at 185.87 MB/s Jul 08 01:18:19 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0762ee21-b8ef-4fd0-83bb-7be60968aaf6 is being set with open permissions: ugo+rw Jul 08 01:18:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0762ee21-b8ef-4fd0-83bb-7be60968aaf6 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:19 devstack sudo[98522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0762ee21-b8ef-4fd0-83bb-7be60968aaf6 Jul 08 01:18:19 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:19 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=72,cinder:UPDATE=70,cinder:INSERT=20,cinder:DELETE=6 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:18:19 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0762ee21-b8ef-4fd0-83bb-7be60968aaf6" returned: 0 in 0.746s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Lock "cinder-quobyte-0762ee21-b8ef-4fd0-83bb-7be60968aaf6" released by "_copy_volume_from_snapshot" :: held 9.021s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:18:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Acquiring lock "cinder-quobyte-7c60c605-db88-47fd-a677-396d55f009b2" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:18:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Lock "cinder-quobyte-7c60c605-db88-47fd-a677-396d55f009b2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:18:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Deleting offline snapshot 7c60c605-db88-47fd-a677-396d55f009b2 of volume 2a999bdc-85f0-4723-9a48-902947546e57 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:18:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] snapshot_file for this snap is: volume-2a999bdc-85f0-4723-9a48-902947546e57.7c60c605-db88-47fd-a677-396d55f009b2 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:18:19 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ede8b0-8909-48ce-aa9e-5b2418e4c45e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:18:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57.7c60c605-db88-47fd-a677-396d55f009b2 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:20 devstack sudo[98525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57.7c60c605-db88-47fd-a677-396d55f009b2 Jul 08 01:18:20 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:20 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57.7c60c605-db88-47fd-a677-396d55f009b2" returned: 0 in 0.856s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:20 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a999bdc-85f0-4723-9a48-902947546e57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:18:20 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d64c76-31df-4f69-b439-184ca60df06d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:18:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:20 devstack sudo[98531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57 Jul 08 01:18:20 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:21 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57" returned: 0 in 0.767s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57.7c60c605-db88-47fd-a677-396d55f009b2 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:21 devstack sudo[98536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57.7c60c605-db88-47fd-a677-396d55f009b2 Jul 08 01:18:21 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:22 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57.7c60c605-db88-47fd-a677-396d55f009b2" returned: 0 in 0.794s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57.7c60c605-db88-47fd-a677-396d55f009b2 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:22 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57.7c60c605-db88-47fd-a677-396d55f009b2 Jul 08 01:18:22 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:23 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57.7c60c605-db88-47fd-a677-396d55f009b2" returned: 0 in 0.700s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:23 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Lock "cinder-quobyte-7c60c605-db88-47fd-a677-396d55f009b2" released by "_delete_snapshot" :: held 3.228s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:18:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.373s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:18:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.758s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:18:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1622113332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e86fe3d-4ac7-45b2-bf78-aa5ebd8300df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='675b6b2393304a58aea20547120ce2ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:18:07Z,use_quota=True,user_id='2d0adfaa93514a63a9aadb3ca7b490a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:18:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Creating volume 2e86fe3d-4ac7-45b2-bf78-aa5ebd8300df {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:18:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:18:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:18:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:18:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:18:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:18:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:18:23 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:18:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2e86fe3d-4ac7-45b2-bf78-aa5ebd8300df 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:23 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2e86fe3d-4ac7-45b2-bf78-aa5ebd8300df 1073741824 Jul 08 01:18:23 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ab0c7a-d1a9-4ed3-97f9-3baa96bd845e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0762ee21-b8ef-4fd0-83bb-7be60968aaf6', 'volume_size': 2, 'source_volid': '2a999bdc-85f0-4723-9a48-902947546e57', 'source_volstatus': 'available'}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddfa84f2-8b48-4807-8532-772d5f67ef73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:23 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Volume volume-0762ee21-b8ef-4fd0-83bb-7be60968aaf6 (0762ee21-b8ef-4fd0-83bb-7be60968aaf6): created successfully Jul 08 01:18:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddfa84f2-8b48-4807-8532-772d5f67ef73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Flow 'volume_create_manager' (884da7a0-5ec6-4302-a726-60954ac54e0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:18:23 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-5810944e-2f55-4438-b664-d38681f819f6 tempest-VolumesCloneTest-1423533524 None] Created volume successfully. Jul 08 01:18:24 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2e86fe3d-4ac7-45b2-bf78-aa5ebd8300df 1073741824" returned: 0 in 0.888s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2e86fe3d-4ac7-45b2-bf78-aa5ebd8300df {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:24 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2e86fe3d-4ac7-45b2-bf78-aa5ebd8300df Jul 08 01:18:24 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a805f342-fb09-40ff-a52d-b1e069291908 tempest-VolumesCloneTest-1423533524 None] Acquiring lock "cinder-0762ee21-b8ef-4fd0-83bb-7be60968aaf6-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:18:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a805f342-fb09-40ff-a52d-b1e069291908 tempest-VolumesCloneTest-1423533524 None] Lock "cinder-0762ee21-b8ef-4fd0-83bb-7be60968aaf6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:18:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a805f342-fb09-40ff-a52d-b1e069291908 tempest-VolumesCloneTest-1423533524 None] Acquiring lock "cinder-quobyte-0762ee21-b8ef-4fd0-83bb-7be60968aaf6" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:18:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a805f342-fb09-40ff-a52d-b1e069291908 tempest-VolumesCloneTest-1423533524 None] Lock "cinder-quobyte-0762ee21-b8ef-4fd0-83bb-7be60968aaf6" acquired by "delete_volume" :: waited 0.014s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:18:24 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94fcac9-466f-4613-b362-99317586d546]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:18:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a805f342-fb09-40ff-a52d-b1e069291908 tempest-VolumesCloneTest-1423533524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0762ee21-b8ef-4fd0-83bb-7be60968aaf6 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:24 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0762ee21-b8ef-4fd0-83bb-7be60968aaf6 Jul 08 01:18:24 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:24 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2e86fe3d-4ac7-45b2-bf78-aa5ebd8300df" returned: 0 in 0.698s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:18:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:18:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-49602323-1a44-4e51-b5c0-5f92de21e739 tempest-VolumesActionsTest-1673967414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 14.541s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:18:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b0966dd-0280-4b8d-a583-def3b28ee7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e86fe3d-4ac7-45b2-bf78-aa5ebd8300df', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf9c2f3e-d8df-488e-b54e-77e80c47f2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:24 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76176f1-d33d-4438-b98b-6b81cc6b7130]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:18:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-49602323-1a44-4e51-b5c0-5f92de21e739 tempest-VolumesActionsTest-1673967414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:24 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Volume volume-2e86fe3d-4ac7-45b2-bf78-aa5ebd8300df (2e86fe3d-4ac7-45b2-bf78-aa5ebd8300df): created successfully Jul 08 01:18:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf9c2f3e-d8df-488e-b54e-77e80c47f2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Flow 'volume_create_manager' (f257836f-bf04-406d-9126-f03a37b09d2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:18:24 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-bf507937-0fba-4f4c-beb1-dc80a69faa51 tempest-VolumesListTestJSON-384817269 None] Created volume successfully. Jul 08 01:18:25 devstack sudo[98555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e Jul 08 01:18:25 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:25 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a805f342-fb09-40ff-a52d-b1e069291908 tempest-VolumesCloneTest-1423533524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0762ee21-b8ef-4fd0-83bb-7be60968aaf6" returned: 0 in 0.845s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a805f342-fb09-40ff-a52d-b1e069291908 tempest-VolumesCloneTest-1423533524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0762ee21-b8ef-4fd0-83bb-7be60968aaf6 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:25 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0762ee21-b8ef-4fd0-83bb-7be60968aaf6 Jul 08 01:18:25 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:25 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-49602323-1a44-4e51-b5c0-5f92de21e739 tempest-VolumesActionsTest-1673967414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e" returned: 0 in 0.864s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:25 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[27265e04-f105-4419-8e37-8fdb743e1133]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:18:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-49602323-1a44-4e51-b5c0-5f92de21e739 tempest-VolumesActionsTest-1673967414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:25 devstack sudo[98565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e Jul 08 01:18:25 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:25 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a805f342-fb09-40ff-a52d-b1e069291908 tempest-VolumesCloneTest-1423533524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0762ee21-b8ef-4fd0-83bb-7be60968aaf6" returned: 0 in 0.651s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:26 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a805f342-fb09-40ff-a52d-b1e069291908 tempest-VolumesCloneTest-1423533524 None] Lock "cinder-quobyte-0762ee21-b8ef-4fd0-83bb-7be60968aaf6" released by "delete_volume" :: held 1.547s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:18:26 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-a805f342-fb09-40ff-a52d-b1e069291908 tempest-VolumesCloneTest-1423533524 None] Created reservations ['8440b536-7406-4284-93a7-7d643d60a541', '15c9b48d-35e8-42fd-80ab-9f447e7f6a58', '7107ae85-67b4-4024-bc15-6ade5a614aa8', '9da36f9c-7664-4338-b698-128122487be9'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:18:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a805f342-fb09-40ff-a52d-b1e069291908 tempest-VolumesCloneTest-1423533524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:18:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a805f342-fb09-40ff-a52d-b1e069291908 tempest-VolumesCloneTest-1423533524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:18:26 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a805f342-fb09-40ff-a52d-b1e069291908 tempest-VolumesCloneTest-1423533524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:18:26 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a805f342-fb09-40ff-a52d-b1e069291908 tempest-VolumesCloneTest-1423533524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:18:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a805f342-fb09-40ff-a52d-b1e069291908 tempest-VolumesCloneTest-1423533524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:18:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a805f342-fb09-40ff-a52d-b1e069291908 tempest-VolumesCloneTest-1423533524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:26 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:18:26 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:26 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-49602323-1a44-4e51-b5c0-5f92de21e739 tempest-VolumesActionsTest-1673967414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e" returned: 0 in 0.970s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-49602323-1a44-4e51-b5c0-5f92de21e739 tempest-VolumesActionsTest-1673967414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e /opt/stack/data/cinder/conversion/63661f0e-c7fe-4b7d-9588-c5e433b0b45e.temp_image.444e2a68-668d-467e-bb4c-8b0155310269n7mok4ck.img {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:26 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-60a289b3-1367-40ea-b689-ad723e35ee34 tempest-VolumesCloneTest-1423533524 None] Acquiring lock "cinder-2a999bdc-85f0-4723-9a48-902947546e57-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:18:26 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e /opt/stack/data/cinder/conversion/63661f0e-c7fe-4b7d-9588-c5e433b0b45e.temp_image.444e2a68-668d-467e-bb4c-8b0155310269n7mok4ck.img Jul 08 01:18:26 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:26 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-60a289b3-1367-40ea-b689-ad723e35ee34 tempest-VolumesCloneTest-1423533524 None] Lock "cinder-2a999bdc-85f0-4723-9a48-902947546e57-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:18:26 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-60a289b3-1367-40ea-b689-ad723e35ee34 tempest-VolumesCloneTest-1423533524 None] Acquiring lock "cinder-quobyte-2a999bdc-85f0-4723-9a48-902947546e57" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:18:26 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-60a289b3-1367-40ea-b689-ad723e35ee34 tempest-VolumesCloneTest-1423533524 None] Lock "cinder-quobyte-2a999bdc-85f0-4723-9a48-902947546e57" acquired by "delete_volume" :: waited 0.030s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:18:26 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[3256aee4-86cf-40e9-900e-a7a9d10d4240]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:18:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-60a289b3-1367-40ea-b689-ad723e35ee34 tempest-VolumesCloneTest-1423533524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:27 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57 Jul 08 01:18:27 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:27 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a805f342-fb09-40ff-a52d-b1e069291908 tempest-VolumesCloneTest-1423533524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.059s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:27 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-a805f342-fb09-40ff-a52d-b1e069291908 tempest-VolumesCloneTest-1423533524 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:18:27 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-a805f342-fb09-40ff-a52d-b1e069291908 tempest-VolumesCloneTest-1423533524 None] Deleted volume successfully. Jul 08 01:18:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a805f342-fb09-40ff-a52d-b1e069291908 tempest-VolumesCloneTest-1423533524 None] Lock "cinder-0762ee21-b8ef-4fd0-83bb-7be60968aaf6-delete_volume" released by "delete_volume" :: held 2.894s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:18:28 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-60a289b3-1367-40ea-b689-ad723e35ee34 tempest-VolumesCloneTest-1423533524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57" returned: 0 in 1.451s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-60a289b3-1367-40ea-b689-ad723e35ee34 tempest-VolumesCloneTest-1423533524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:28 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57 Jul 08 01:18:28 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:30 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-60a289b3-1367-40ea-b689-ad723e35ee34 tempest-VolumesCloneTest-1423533524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2a999bdc-85f0-4723-9a48-902947546e57" returned: 0 in 2.108s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:30 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-60a289b3-1367-40ea-b689-ad723e35ee34 tempest-VolumesCloneTest-1423533524 None] Lock "cinder-quobyte-2a999bdc-85f0-4723-9a48-902947546e57" released by "delete_volume" :: held 3.665s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:18:30 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-60a289b3-1367-40ea-b689-ad723e35ee34 tempest-VolumesCloneTest-1423533524 None] Created reservations ['5d194b1d-d1d6-4a32-b158-5f7faaa0d250', '5f6c396b-680c-4998-b511-95178ebb6261', 'd4b54291-5e0b-484c-9506-cdfae7a2064f', 'f9d02654-23e2-4841-9fd2-f3f0ba66b903'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:18:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-60a289b3-1367-40ea-b689-ad723e35ee34 tempest-VolumesCloneTest-1423533524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:18:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-60a289b3-1367-40ea-b689-ad723e35ee34 tempest-VolumesCloneTest-1423533524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:18:30 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-60a289b3-1367-40ea-b689-ad723e35ee34 tempest-VolumesCloneTest-1423533524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:18:30 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-60a289b3-1367-40ea-b689-ad723e35ee34 tempest-VolumesCloneTest-1423533524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:18:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-60a289b3-1367-40ea-b689-ad723e35ee34 tempest-VolumesCloneTest-1423533524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:18:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-60a289b3-1367-40ea-b689-ad723e35ee34 tempest-VolumesCloneTest-1423533524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:31 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:18:31 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d8898716-b813-4b13-b995-5de6a40e47d8 tempest-VolumesListTestJSON-384817269 None] Acquiring lock "cinder-2e86fe3d-4ac7-45b2-bf78-aa5ebd8300df-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:18:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d8898716-b813-4b13-b995-5de6a40e47d8 tempest-VolumesListTestJSON-384817269 None] Lock "cinder-2e86fe3d-4ac7-45b2-bf78-aa5ebd8300df-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:18:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d8898716-b813-4b13-b995-5de6a40e47d8 tempest-VolumesListTestJSON-384817269 None] Acquiring lock "cinder-quobyte-2e86fe3d-4ac7-45b2-bf78-aa5ebd8300df" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:18:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d8898716-b813-4b13-b995-5de6a40e47d8 tempest-VolumesListTestJSON-384817269 None] Lock "cinder-quobyte-2e86fe3d-4ac7-45b2-bf78-aa5ebd8300df" acquired by "delete_volume" :: waited 0.082s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:18:31 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[611edc7d-9315-450c-853c-7133c25f8692]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:18:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d8898716-b813-4b13-b995-5de6a40e47d8 tempest-VolumesListTestJSON-384817269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2e86fe3d-4ac7-45b2-bf78-aa5ebd8300df {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:32 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2e86fe3d-4ac7-45b2-bf78-aa5ebd8300df Jul 08 01:18:32 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:33 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-60a289b3-1367-40ea-b689-ad723e35ee34 tempest-VolumesCloneTest-1423533524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 2.108s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:33 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-60a289b3-1367-40ea-b689-ad723e35ee34 tempest-VolumesCloneTest-1423533524 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:18:33 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-60a289b3-1367-40ea-b689-ad723e35ee34 tempest-VolumesCloneTest-1423533524 None] Deleted volume successfully. Jul 08 01:18:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-60a289b3-1367-40ea-b689-ad723e35ee34 tempest-VolumesCloneTest-1423533524 None] Lock "cinder-2a999bdc-85f0-4723-9a48-902947546e57-delete_volume" released by "delete_volume" :: held 6.395s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:18:33 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-49602323-1a44-4e51-b5c0-5f92de21e739 tempest-VolumesActionsTest-1673967414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e /opt/stack/data/cinder/conversion/63661f0e-c7fe-4b7d-9588-c5e433b0b45e.temp_image.444e2a68-668d-467e-bb4c-8b0155310269n7mok4ck.img" returned: 0 in 6.734s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:33 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[063e3682-9184-45ab-90da-b3af1e27db42]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:18:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-49602323-1a44-4e51-b5c0-5f92de21e739 tempest-VolumesActionsTest-1673967414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:33 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d8898716-b813-4b13-b995-5de6a40e47d8 tempest-VolumesListTestJSON-384817269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2e86fe3d-4ac7-45b2-bf78-aa5ebd8300df" returned: 0 in 1.768s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d8898716-b813-4b13-b995-5de6a40e47d8 tempest-VolumesListTestJSON-384817269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2e86fe3d-4ac7-45b2-bf78-aa5ebd8300df {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:33 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2e86fe3d-4ac7-45b2-bf78-aa5ebd8300df Jul 08 01:18:33 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:33 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e Jul 08 01:18:33 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:34 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d8898716-b813-4b13-b995-5de6a40e47d8 tempest-VolumesListTestJSON-384817269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2e86fe3d-4ac7-45b2-bf78-aa5ebd8300df" returned: 0 in 0.959s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:34 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d8898716-b813-4b13-b995-5de6a40e47d8 tempest-VolumesListTestJSON-384817269 None] Lock "cinder-quobyte-2e86fe3d-4ac7-45b2-bf78-aa5ebd8300df" released by "delete_volume" :: held 2.850s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:18:34 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-49602323-1a44-4e51-b5c0-5f92de21e739 tempest-VolumesActionsTest-1673967414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e" returned: 0 in 1.190s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:34 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-49602323-1a44-4e51-b5c0-5f92de21e739 tempest-VolumesActionsTest-1673967414 None] Image conversion details: src /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e, size 1024.00 MB, duration 6.74 sec, destination /opt/stack/data/cinder/conversion/63661f0e-c7fe-4b7d-9588-c5e433b0b45e.temp_image.444e2a68-668d-467e-bb4c-8b0155310269n7mok4ck.img {{(pid=87022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:18:34 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-49602323-1a44-4e51-b5c0-5f92de21e739 tempest-VolumesActionsTest-1673967414 None] Converted 1024.00 MB image at 152.04 MB/s Jul 08 01:18:34 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-49602323-1a44-4e51-b5c0-5f92de21e739 tempest-VolumesActionsTest-1673967414 None] 444e2a68-668d-467e-bb4c-8b0155310269 was raw, no need to convert to raw {{(pid=87022) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 08 01:18:34 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-d8898716-b813-4b13-b995-5de6a40e47d8 tempest-VolumesListTestJSON-384817269 None] Created reservations ['b1711b43-8c85-4905-bb56-f1a62a1919f5', '06bdf2fa-6dfd-47b2-b3e8-fddd72bb584c', 'b24eb738-8579-48a7-a2b2-38d0fdfaedcc', 'd8873796-085c-4df1-8151-7875a228c439'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:18:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d8898716-b813-4b13-b995-5de6a40e47d8 tempest-VolumesListTestJSON-384817269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:18:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d8898716-b813-4b13-b995-5de6a40e47d8 tempest-VolumesListTestJSON-384817269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:18:34 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d8898716-b813-4b13-b995-5de6a40e47d8 tempest-VolumesListTestJSON-384817269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:18:34 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d8898716-b813-4b13-b995-5de6a40e47d8 tempest-VolumesListTestJSON-384817269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:18:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d8898716-b813-4b13-b995-5de6a40e47d8 tempest-VolumesListTestJSON-384817269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:18:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d8898716-b813-4b13-b995-5de6a40e47d8 tempest-VolumesListTestJSON-384817269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:34 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:18:34 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c00c4c61-9edc-4a90-9676-70afe15a0bfe tempest-VolumesListTestJSON-384817269 None] Acquiring lock "cinder-027c54d6-8c07-4826-bb56-3f189c360bf1-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:18:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c00c4c61-9edc-4a90-9676-70afe15a0bfe tempest-VolumesListTestJSON-384817269 None] Lock "cinder-027c54d6-8c07-4826-bb56-3f189c360bf1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:18:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c00c4c61-9edc-4a90-9676-70afe15a0bfe tempest-VolumesListTestJSON-384817269 None] Acquiring lock "cinder-quobyte-027c54d6-8c07-4826-bb56-3f189c360bf1" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:18:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c00c4c61-9edc-4a90-9676-70afe15a0bfe tempest-VolumesListTestJSON-384817269 None] Lock "cinder-quobyte-027c54d6-8c07-4826-bb56-3f189c360bf1" acquired by "delete_volume" :: waited 0.022s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:18:35 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[021ce638-1f54-4eb0-925a-cd3d92c8a37c]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:18:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c00c4c61-9edc-4a90-9676-70afe15a0bfe tempest-VolumesListTestJSON-384817269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-027c54d6-8c07-4826-bb56-3f189c360bf1 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:35 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-027c54d6-8c07-4826-bb56-3f189c360bf1 Jul 08 01:18:35 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:36 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d8898716-b813-4b13-b995-5de6a40e47d8 tempest-VolumesListTestJSON-384817269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.199s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:36 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-d8898716-b813-4b13-b995-5de6a40e47d8 tempest-VolumesListTestJSON-384817269 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:18:36 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-d8898716-b813-4b13-b995-5de6a40e47d8 tempest-VolumesListTestJSON-384817269 None] Deleted volume successfully. Jul 08 01:18:36 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d8898716-b813-4b13-b995-5de6a40e47d8 tempest-VolumesListTestJSON-384817269 None] Lock "cinder-2e86fe3d-4ac7-45b2-bf78-aa5ebd8300df-delete_volume" released by "delete_volume" :: held 4.611s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:18:36 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c00c4c61-9edc-4a90-9676-70afe15a0bfe tempest-VolumesListTestJSON-384817269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-027c54d6-8c07-4826-bb56-3f189c360bf1" returned: 0 in 1.311s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c00c4c61-9edc-4a90-9676-70afe15a0bfe tempest-VolumesListTestJSON-384817269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-027c54d6-8c07-4826-bb56-3f189c360bf1 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:36 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-027c54d6-8c07-4826-bb56-3f189c360bf1 Jul 08 01:18:36 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:36 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:18:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Flow 'volume_create_manager' (21c16a86-b653-4c68-92bf-459a49f9d4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:18:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9c41ed-6567-4036-8bec-1cd118c3aa7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9c41ed-6567-4036-8bec-1cd118c3aa7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-449029591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3436b6ba-2222-4883-904d-8ec1c3a476f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492e2b4bd96d4f3da8e7b513b93cc249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:18:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:18:37Z,use_quota=True,user_id='2c436ac015b547fe8f887d5ffba0f7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb7117f2-d3db-4498-a265-78ab7e6f88ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb7117f2-d3db-4498-a265-78ab7e6f88ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (030623d7-74bb-4545-9523-f0dbcae715af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (030623d7-74bb-4545-9523-f0dbcae715af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3436b6ba-2222-4883-904d-8ec1c3a476f3', 'volume_name': 'volume-3436b6ba-2222-4883-904d-8ec1c3a476f3', 'volume_size': 2}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c9a712-98e9-4186-8b75-9684f0d219f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c9a712-98e9-4186-8b75-9684f0d219f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b86e884-798f-4bd5-a4b8-c3f37905e563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:37 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Volume 3436b6ba-2222-4883-904d-8ec1c3a476f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3436b6ba-2222-4883-904d-8ec1c3a476f3', 'volume_size': 2} Jul 08 01:18:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:18:37 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c00c4c61-9edc-4a90-9676-70afe15a0bfe tempest-VolumesListTestJSON-384817269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-027c54d6-8c07-4826-bb56-3f189c360bf1" returned: 0 in 0.912s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:37 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c00c4c61-9edc-4a90-9676-70afe15a0bfe tempest-VolumesListTestJSON-384817269 None] Lock "cinder-quobyte-027c54d6-8c07-4826-bb56-3f189c360bf1" released by "delete_volume" :: held 2.287s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:18:37 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-c00c4c61-9edc-4a90-9676-70afe15a0bfe tempest-VolumesListTestJSON-384817269 None] Created reservations ['942f3883-3939-4bdb-abc4-ddb597c0ee1e', '03ba04f1-0a71-413e-81ba-9d78351f39ce', '46a2e5cb-4e54-4909-9a92-ea714e6e3ccc', 'ded88643-bf54-439c-81f4-80bad28538b5'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:18:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c00c4c61-9edc-4a90-9676-70afe15a0bfe tempest-VolumesListTestJSON-384817269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:18:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c00c4c61-9edc-4a90-9676-70afe15a0bfe tempest-VolumesListTestJSON-384817269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:18:37 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c00c4c61-9edc-4a90-9676-70afe15a0bfe tempest-VolumesListTestJSON-384817269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:18:37 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c00c4c61-9edc-4a90-9676-70afe15a0bfe tempest-VolumesListTestJSON-384817269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:18:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c00c4c61-9edc-4a90-9676-70afe15a0bfe tempest-VolumesListTestJSON-384817269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:18:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c00c4c61-9edc-4a90-9676-70afe15a0bfe tempest-VolumesListTestJSON-384817269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:37 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:18:37 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:38 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e940a49d-889a-445b-9e0a-fbb6701293a8 tempest-VolumesListTestJSON-384817269 None] Acquiring lock "cinder-fb67a4d8-bb65-48a0-b529-7f2a37d0e6c2-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:18:38 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e940a49d-889a-445b-9e0a-fbb6701293a8 tempest-VolumesListTestJSON-384817269 None] Lock "cinder-fb67a4d8-bb65-48a0-b529-7f2a37d0e6c2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:18:38 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c00c4c61-9edc-4a90-9676-70afe15a0bfe tempest-VolumesListTestJSON-384817269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.983s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:38 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-c00c4c61-9edc-4a90-9676-70afe15a0bfe tempest-VolumesListTestJSON-384817269 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:18:38 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-c00c4c61-9edc-4a90-9676-70afe15a0bfe tempest-VolumesListTestJSON-384817269 None] Deleted volume successfully. Jul 08 01:18:38 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e940a49d-889a-445b-9e0a-fbb6701293a8 tempest-VolumesListTestJSON-384817269 None] Acquiring lock "cinder-quobyte-fb67a4d8-bb65-48a0-b529-7f2a37d0e6c2" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:18:38 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c00c4c61-9edc-4a90-9676-70afe15a0bfe tempest-VolumesListTestJSON-384817269 None] Lock "cinder-027c54d6-8c07-4826-bb56-3f189c360bf1-delete_volume" released by "delete_volume" :: held 3.617s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:18:38 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e940a49d-889a-445b-9e0a-fbb6701293a8 tempest-VolumesListTestJSON-384817269 None] Lock "cinder-quobyte-fb67a4d8-bb65-48a0-b529-7f2a37d0e6c2" acquired by "delete_volume" :: waited 0.023s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:18:38 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a55d40-b91e-4231-82da-4a148785c88b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:18:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e940a49d-889a-445b-9e0a-fbb6701293a8 tempest-VolumesListTestJSON-384817269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb67a4d8-bb65-48a0-b529-7f2a37d0e6c2 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:38 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb67a4d8-bb65-48a0-b529-7f2a37d0e6c2 Jul 08 01:18:38 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:39 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e940a49d-889a-445b-9e0a-fbb6701293a8 tempest-VolumesListTestJSON-384817269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb67a4d8-bb65-48a0-b529-7f2a37d0e6c2" returned: 0 in 0.951s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e940a49d-889a-445b-9e0a-fbb6701293a8 tempest-VolumesListTestJSON-384817269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb67a4d8-bb65-48a0-b529-7f2a37d0e6c2 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:39 devstack sudo[98632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb67a4d8-bb65-48a0-b529-7f2a37d0e6c2 Jul 08 01:18:39 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:40 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e940a49d-889a-445b-9e0a-fbb6701293a8 tempest-VolumesListTestJSON-384817269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb67a4d8-bb65-48a0-b529-7f2a37d0e6c2" returned: 0 in 0.782s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:40 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e940a49d-889a-445b-9e0a-fbb6701293a8 tempest-VolumesListTestJSON-384817269 None] Lock "cinder-quobyte-fb67a4d8-bb65-48a0-b529-7f2a37d0e6c2" released by "delete_volume" :: held 1.793s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:18:40 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-e940a49d-889a-445b-9e0a-fbb6701293a8 tempest-VolumesListTestJSON-384817269 None] Created reservations ['3c07ccd2-d5b0-4b1c-a5dc-1919e9713596', '1b04d539-835c-496f-84ba-9337e28c98b9', 'f4c6b22b-a663-4ce9-a5b1-9845e5fffd56', '31ba40ac-1fc3-4428-94ae-af218d42d9da'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:18:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e940a49d-889a-445b-9e0a-fbb6701293a8 tempest-VolumesListTestJSON-384817269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:18:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e940a49d-889a-445b-9e0a-fbb6701293a8 tempest-VolumesListTestJSON-384817269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:18:40 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e940a49d-889a-445b-9e0a-fbb6701293a8 tempest-VolumesListTestJSON-384817269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:18:40 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e940a49d-889a-445b-9e0a-fbb6701293a8 tempest-VolumesListTestJSON-384817269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:18:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e940a49d-889a-445b-9e0a-fbb6701293a8 tempest-VolumesListTestJSON-384817269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:18:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e940a49d-889a-445b-9e0a-fbb6701293a8 tempest-VolumesListTestJSON-384817269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:40 devstack sudo[98635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:18:40 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:41 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e940a49d-889a-445b-9e0a-fbb6701293a8 tempest-VolumesListTestJSON-384817269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.118s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:41 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-e940a49d-889a-445b-9e0a-fbb6701293a8 tempest-VolumesListTestJSON-384817269 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:18:41 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-e940a49d-889a-445b-9e0a-fbb6701293a8 tempest-VolumesListTestJSON-384817269 None] Deleted volume successfully. Jul 08 01:18:41 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e940a49d-889a-445b-9e0a-fbb6701293a8 tempest-VolumesListTestJSON-384817269 None] Lock "cinder-fb67a4d8-bb65-48a0-b529-7f2a37d0e6c2-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:18:45 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:18:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:18:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:18:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:18:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:18:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:18:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:45 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:18:45 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:46 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:18:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Flow 'volume_create_manager' (cb543f00-c8c2-42ee-9b77-281eb707e361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:18:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d214f2e4-078f-419e-98b3-82da0e79defb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d214f2e4-078f-419e-98b3-82da0e79defb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1306707796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1823ee5e-297d-4da1-a7f1-08324c562de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da8bb5b44e80467098807266c7bc5b3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:18:46Z,use_quota=True,user_id='9dc46617778e41a3b17c2c5619f36e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3247255e-d42f-4398-a9e4-154675e0fd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3247255e-d42f-4398-a9e4-154675e0fd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b7126a2-a880-4f7c-a1c4-44eb01ab4e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b7126a2-a880-4f7c-a1c4-44eb01ab4e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1823ee5e-297d-4da1-a7f1-08324c562de1', 'volume_name': 'volume-1823ee5e-297d-4da1-a7f1-08324c562de1', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca7d581f-7c35-4802-b61f-1ff50c6fceaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca7d581f-7c35-4802-b61f-1ff50c6fceaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b61b625b-0f57-48ac-89f9-1a2f978f015f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:46 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Volume 1823ee5e-297d-4da1-a7f1-08324c562de1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1823ee5e-297d-4da1-a7f1-08324c562de1', 'volume_size': 1} Jul 08 01:18:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:18:46 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.094s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:46 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:18:46 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:18:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread count: 28 {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:18:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread info: [<_MainThread(MainThread, started 134382216167552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:18:49 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:18:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Flow 'volume_create_manager' (651c75ef-eea3-4356-bc85-9f467781bff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:18:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dccc7bb-ed57-4efc-8177-8e8e527c50a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dccc7bb-ed57-4efc-8177-8e8e527c50a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-456774535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47051ab9-b825-4531-a212-2fcb7e5f26af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bb4223b5316431d9fb9be5ec36a7894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:18:49Z,use_quota=True,user_id='2e6343fae1ec43a18a45664c3f9a632b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (132b8254-eee2-4179-ae36-8b2ab4e4c155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (132b8254-eee2-4179-ae36-8b2ab4e4c155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (181b1359-6207-4bc8-b10a-0a6583e21c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (181b1359-6207-4bc8-b10a-0a6583e21c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47051ab9-b825-4531-a212-2fcb7e5f26af', 'volume_name': 'volume-47051ab9-b825-4531-a212-2fcb7e5f26af', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e957f8d-b57c-4586-824e-94e4f3a9915b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e957f8d-b57c-4586-824e-94e4f3a9915b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c36556c-693d-4ca2-9cce-4b6d8b1b9e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:49 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Volume 47051ab9-b825-4531-a212-2fcb7e5f26af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47051ab9-b825-4531-a212-2fcb7e5f26af', 'volume_size': 1} Jul 08 01:18:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:18:49 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:18:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Flow 'volume_create_manager' (6dd991c1-b4fa-4730-9e98-fb79f85095a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:18:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4184d031-c171-4e82-91d0-092a84add475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4184d031-c171-4e82-91d0-092a84add475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1349442541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a61a12f6-2389-4a20-a03b-0b2a058e27b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bb4223b5316431d9fb9be5ec36a7894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:18:50Z,use_quota=True,user_id='2e6343fae1ec43a18a45664c3f9a632b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd297ed2-62ed-4d24-946d-20f0521178b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd297ed2-62ed-4d24-946d-20f0521178b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b9bf3a-0010-4a8b-a477-223cdff67545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b9bf3a-0010-4a8b-a477-223cdff67545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a61a12f6-2389-4a20-a03b-0b2a058e27b2', 'volume_name': 'volume-a61a12f6-2389-4a20-a03b-0b2a058e27b2', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc02af1-5b7a-41a1-90c6-52b7939ec882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc02af1-5b7a-41a1-90c6-52b7939ec882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2cbc89-ed91-43c8-84c9-2f16ac91f9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:49 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Volume a61a12f6-2389-4a20-a03b-0b2a058e27b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a61a12f6-2389-4a20-a03b-0b2a058e27b2', 'volume_size': 1} Jul 08 01:18:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:18:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-49602323-1a44-4e51-b5c0-5f92de21e739 tempest-VolumesActionsTest-1673967414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.716s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:18:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-49602323-1a44-4e51-b5c0-5f92de21e739 tempest-VolumesActionsTest-1673967414 None] Uploaded volume to glance image-id: 444e2a68-668d-467e-bb4c-8b0155310269. {{(pid=87022) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 01:18:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.563s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:18:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-449029591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3436b6ba-2222-4883-904d-8ec1c3a476f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492e2b4bd96d4f3da8e7b513b93cc249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:18:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:18:37Z,use_quota=True,user_id='2c436ac015b547fe8f887d5ffba0f7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:18:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Creating volume 3436b6ba-2222-4883-904d-8ec1c3a476f3 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:18:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:18:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:18:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:18:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:18:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:18:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:18:58 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:18:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3436b6ba-2222-4883-904d-8ec1c3a476f3 2147483648 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:58 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-49602323-1a44-4e51-b5c0-5f92de21e739 tempest-VolumesActionsTest-1673967414 None] Copy volume to image completed successfully. Jul 08 01:18:58 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3436b6ba-2222-4883-904d-8ec1c3a476f3 2147483648 Jul 08 01:18:58 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:59 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3436b6ba-2222-4883-904d-8ec1c3a476f3 2147483648" returned: 0 in 1.093s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3436b6ba-2222-4883-904d-8ec1c3a476f3 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:59 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3436b6ba-2222-4883-904d-8ec1c3a476f3 Jul 08 01:18:59 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4456be26-4d99-412a-b93e-a9c0b1a06c3d tempest-VolumesActionsTest-1673967414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:19:00 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3436b6ba-2222-4883-904d-8ec1c3a476f3" returned: 0 in 0.679s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:00 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:19:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.215s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:00 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1306707796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1823ee5e-297d-4da1-a7f1-08324c562de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da8bb5b44e80467098807266c7bc5b3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:18:46Z,use_quota=True,user_id='9dc46617778e41a3b17c2c5619f36e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:19:00 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Creating volume 1823ee5e-297d-4da1-a7f1-08324c562de1 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:19:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:19:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:00 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:19:00 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:19:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:00 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:19:00 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:19:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1823ee5e-297d-4da1-a7f1-08324c562de1 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b86e884-798f-4bd5-a4b8-c3f37905e563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3436b6ba-2222-4883-904d-8ec1c3a476f3', 'volume_size': 2}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:19:00 devstack sudo[98672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1823ee5e-297d-4da1-a7f1-08324c562de1 1073741824 Jul 08 01:19:00 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d73c63-dfe3-4b7b-ac49-9af601b5980c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:19:00 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Volume volume-3436b6ba-2222-4883-904d-8ec1c3a476f3 (3436b6ba-2222-4883-904d-8ec1c3a476f3): created successfully Jul 08 01:19:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d73c63-dfe3-4b7b-ac49-9af601b5980c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:19:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Flow 'volume_create_manager' (21c16a86-b653-4c68-92bf-459a49f9d4f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:19:00 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-42aea1b8-779a-4106-b2e8-fcbfaee8396a tempest-VolumesCloneNegativeTest-1691324045 None] Created volume successfully. Jul 08 01:19:01 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-33a04dad-92fa-4106-aecc-638459898d8f tempest-VolumesCloneNegativeTest-1691324045 None] Acquiring lock "cinder-3436b6ba-2222-4883-904d-8ec1c3a476f3-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:19:01 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-33a04dad-92fa-4106-aecc-638459898d8f tempest-VolumesCloneNegativeTest-1691324045 None] Lock "cinder-3436b6ba-2222-4883-904d-8ec1c3a476f3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:19:01 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-33a04dad-92fa-4106-aecc-638459898d8f tempest-VolumesCloneNegativeTest-1691324045 None] Acquiring lock "cinder-quobyte-3436b6ba-2222-4883-904d-8ec1c3a476f3" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:19:01 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-33a04dad-92fa-4106-aecc-638459898d8f tempest-VolumesCloneNegativeTest-1691324045 None] Lock "cinder-quobyte-3436b6ba-2222-4883-904d-8ec1c3a476f3" acquired by "delete_volume" :: waited 0.023s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:19:01 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e00ba8e-89e0-4ed5-b573-f16f61eae803]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:19:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-33a04dad-92fa-4106-aecc-638459898d8f tempest-VolumesCloneNegativeTest-1691324045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3436b6ba-2222-4883-904d-8ec1c3a476f3 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:01 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3436b6ba-2222-4883-904d-8ec1c3a476f3 Jul 08 01:19:01 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:01 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1823ee5e-297d-4da1-a7f1-08324c562de1 1073741824" returned: 0 in 1.032s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1823ee5e-297d-4da1-a7f1-08324c562de1 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:01 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1823ee5e-297d-4da1-a7f1-08324c562de1 Jul 08 01:19:01 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:02 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-33a04dad-92fa-4106-aecc-638459898d8f tempest-VolumesCloneNegativeTest-1691324045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3436b6ba-2222-4883-904d-8ec1c3a476f3" returned: 0 in 0.922s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-33a04dad-92fa-4106-aecc-638459898d8f tempest-VolumesCloneNegativeTest-1691324045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3436b6ba-2222-4883-904d-8ec1c3a476f3 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:02 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3436b6ba-2222-4883-904d-8ec1c3a476f3 Jul 08 01:19:02 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:02 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1823ee5e-297d-4da1-a7f1-08324c562de1" returned: 0 in 0.806s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:19:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.823s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-456774535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47051ab9-b825-4531-a212-2fcb7e5f26af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bb4223b5316431d9fb9be5ec36a7894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:18:49Z,use_quota=True,user_id='2e6343fae1ec43a18a45664c3f9a632b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:19:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Creating volume 47051ab9-b825-4531-a212-2fcb7e5f26af {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:19:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:19:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:19:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:19:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:19:02 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:19:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-47051ab9-b825-4531-a212-2fcb7e5f26af 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:02 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-47051ab9-b825-4531-a212-2fcb7e5f26af 1073741824 Jul 08 01:19:02 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b61b625b-0f57-48ac-89f9-1a2f978f015f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1823ee5e-297d-4da1-a7f1-08324c562de1', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:19:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69487ac-ec81-419f-b9eb-fe3b2af1a9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:19:02 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Volume volume-1823ee5e-297d-4da1-a7f1-08324c562de1 (1823ee5e-297d-4da1-a7f1-08324c562de1): created successfully Jul 08 01:19:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69487ac-ec81-419f-b9eb-fe3b2af1a9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:19:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Flow 'volume_create_manager' (cb543f00-c8c2-42ee-9b77-281eb707e361) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:19:02 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-346cd7ec-6aa4-45af-91ff-4eda088c0884 tempest-VolumesNegativeTest-71153331 None] Created volume successfully. Jul 08 01:19:03 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-33a04dad-92fa-4106-aecc-638459898d8f tempest-VolumesCloneNegativeTest-1691324045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3436b6ba-2222-4883-904d-8ec1c3a476f3" returned: 0 in 1.007s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:03 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-33a04dad-92fa-4106-aecc-638459898d8f tempest-VolumesCloneNegativeTest-1691324045 None] Lock "cinder-quobyte-3436b6ba-2222-4883-904d-8ec1c3a476f3" released by "delete_volume" :: held 1.980s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:19:03 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-33a04dad-92fa-4106-aecc-638459898d8f tempest-VolumesCloneNegativeTest-1691324045 None] Created reservations ['ec575a66-623a-4783-a2d9-b85c7a54f26c', '404d9363-d4e7-4f23-87a1-b8e8c5793573', 'e53eb11e-1ec2-4e60-a82e-26fff5214b19', 'd98c08f6-6cdf-4a52-85a4-b3bced553182'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:19:03 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:UPDATE=65,cinder:SELECT=48,cinder:INSERT=15,cinder:DELETE=5 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:19:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-33a04dad-92fa-4106-aecc-638459898d8f tempest-VolumesCloneNegativeTest-1691324045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:19:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-33a04dad-92fa-4106-aecc-638459898d8f tempest-VolumesCloneNegativeTest-1691324045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:03 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-33a04dad-92fa-4106-aecc-638459898d8f tempest-VolumesCloneNegativeTest-1691324045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:19:03 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-33a04dad-92fa-4106-aecc-638459898d8f tempest-VolumesCloneNegativeTest-1691324045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:19:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-33a04dad-92fa-4106-aecc-638459898d8f tempest-VolumesCloneNegativeTest-1691324045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-33a04dad-92fa-4106-aecc-638459898d8f tempest-VolumesCloneNegativeTest-1691324045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:03 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:19:03 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:03 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-47051ab9-b825-4531-a212-2fcb7e5f26af 1073741824" returned: 0 in 1.508s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-47051ab9-b825-4531-a212-2fcb7e5f26af {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:03 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-47051ab9-b825-4531-a212-2fcb7e5f26af Jul 08 01:19:03 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:04 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-33a04dad-92fa-4106-aecc-638459898d8f tempest-VolumesCloneNegativeTest-1691324045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.981s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:04 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-33a04dad-92fa-4106-aecc-638459898d8f tempest-VolumesCloneNegativeTest-1691324045 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:19:04 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-33a04dad-92fa-4106-aecc-638459898d8f tempest-VolumesCloneNegativeTest-1691324045 None] Deleted volume successfully. Jul 08 01:19:04 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-33a04dad-92fa-4106-aecc-638459898d8f tempest-VolumesCloneNegativeTest-1691324045 None] Lock "cinder-3436b6ba-2222-4883-904d-8ec1c3a476f3-delete_volume" released by "delete_volume" :: held 3.473s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:19:04 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-47051ab9-b825-4531-a212-2fcb7e5f26af" returned: 0 in 1.057s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] <== create_volume: return (2632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:19:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.637s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.082s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1349442541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a61a12f6-2389-4a20-a03b-0b2a058e27b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bb4223b5316431d9fb9be5ec36a7894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:18:50Z,use_quota=True,user_id='2e6343fae1ec43a18a45664c3f9a632b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:19:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Creating volume a61a12f6-2389-4a20-a03b-0b2a058e27b2 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:19:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:19:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:19:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:19:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:19:04 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:19:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a61a12f6-2389-4a20-a03b-0b2a058e27b2 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:05 devstack sudo[98769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a61a12f6-2389-4a20-a03b-0b2a058e27b2 1073741824 Jul 08 01:19:05 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c36556c-693d-4ca2-9cce-4b6d8b1b9e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47051ab9-b825-4531-a212-2fcb7e5f26af', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:19:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497f435b-5c26-4699-bdb1-4c1890f29ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:19:05 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Volume volume-47051ab9-b825-4531-a212-2fcb7e5f26af (47051ab9-b825-4531-a212-2fcb7e5f26af): created successfully Jul 08 01:19:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497f435b-5c26-4699-bdb1-4c1890f29ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:19:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Flow 'volume_create_manager' (651c75ef-eea3-4356-bc85-9f467781bff3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:19:05 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-a1f72287-a5bc-4b1c-b2fc-622b0dff7489 tempest-TestServerVolumeAttachmentScenario-168066397 None] Created volume successfully. Jul 08 01:19:06 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a61a12f6-2389-4a20-a03b-0b2a058e27b2 1073741824" returned: 0 in 1.186s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a61a12f6-2389-4a20-a03b-0b2a058e27b2 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:06 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a61a12f6-2389-4a20-a03b-0b2a058e27b2 Jul 08 01:19:06 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:07 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a61a12f6-2389-4a20-a03b-0b2a058e27b2" returned: 0 in 1.154s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:07 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] <== create_volume: return (2420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:19:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.428s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4456be26-4d99-412a-b93e-a9c0b1a06c3d tempest-VolumesActionsTest-1673967414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 7.339s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2cbc89-ed91-43c8-84c9-2f16ac91f9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a61a12f6-2389-4a20-a03b-0b2a058e27b2', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:19:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d807dba5-dfbd-45d0-b013-3b4a084ebd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:19:07 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[51be6157-be7d-49ac-8da8-8c10d9660976]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:19:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4456be26-4d99-412a-b93e-a9c0b1a06c3d tempest-VolumesActionsTest-1673967414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:07 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Volume volume-a61a12f6-2389-4a20-a03b-0b2a058e27b2 (a61a12f6-2389-4a20-a03b-0b2a058e27b2): created successfully Jul 08 01:19:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d807dba5-dfbd-45d0-b013-3b4a084ebd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:19:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Flow 'volume_create_manager' (6dd991c1-b4fa-4730-9e98-fb79f85095a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:19:07 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-c2891011-6a42-46a7-9916-8b4520730d4c tempest-TestServerVolumeAttachmentScenario-168066397 None] Created volume successfully. Jul 08 01:19:07 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e Jul 08 01:19:07 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:08 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4456be26-4d99-412a-b93e-a9c0b1a06c3d tempest-VolumesActionsTest-1673967414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e" returned: 0 in 1.149s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:08 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfd6e93-e512-4803-bd8b-05aaea19bcbe]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:19:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4456be26-4d99-412a-b93e-a9c0b1a06c3d tempest-VolumesActionsTest-1673967414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:08 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e Jul 08 01:19:08 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:09 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:19:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Flow 'volume_create_manager' (d48c0ea1-0013-4186-ac9c-06905acabe06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:19:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de89625-d680-47fa-a02a-38b062688091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:19:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de89625-d680-47fa-a02a-38b062688091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1718048234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b80c86c5-7f2c-47c4-91de-40a789f208d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e2058be18b4e1ea8e3ee19bc073321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:19:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:19:09Z,use_quota=True,user_id='1275a54faecc48f68a817b3e2d2eb88e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:19:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5de9676-8cea-44b6-a010-c5ac7b90d2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:19:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5de9676-8cea-44b6-a010-c5ac7b90d2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:19:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06970841-c60f-4d00-9b0c-ec7f4023bad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:19:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06970841-c60f-4d00-9b0c-ec7f4023bad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b80c86c5-7f2c-47c4-91de-40a789f208d4', 'volume_name': 'volume-b80c86c5-7f2c-47c4-91de-40a789f208d4', 'volume_size': 2}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:19:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dcf0652-bc59-4389-8708-5796e1984989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:19:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dcf0652-bc59-4389-8708-5796e1984989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:19:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9565eb8b-f021-4ed9-b69b-241c82e3e141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:19:09 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Volume b80c86c5-7f2c-47c4-91de-40a789f208d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b80c86c5-7f2c-47c4-91de-40a789f208d4', 'volume_size': 2} Jul 08 01:19:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:19:09 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4456be26-4d99-412a-b93e-a9c0b1a06c3d tempest-VolumesActionsTest-1673967414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e" returned: 0 in 1.065s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4456be26-4d99-412a-b93e-a9c0b1a06c3d tempest-VolumesActionsTest-1673967414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e /opt/stack/data/cinder/conversion/63661f0e-c7fe-4b7d-9588-c5e433b0b45e.temp_image.d13561ac-21b1-4975-9852-7d8a26c636415fel_8t1.img {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:09 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e /opt/stack/data/cinder/conversion/63661f0e-c7fe-4b7d-9588-c5e433b0b45e.temp_image.d13561ac-21b1-4975-9852-7d8a26c636415fel_8t1.img Jul 08 01:19:09 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:18 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4456be26-4d99-412a-b93e-a9c0b1a06c3d tempest-VolumesActionsTest-1673967414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e /opt/stack/data/cinder/conversion/63661f0e-c7fe-4b7d-9588-c5e433b0b45e.temp_image.d13561ac-21b1-4975-9852-7d8a26c636415fel_8t1.img" returned: 0 in 8.418s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:18 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9a6de2-eed2-4f7b-ab0a-aad3efcab64f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:19:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4456be26-4d99-412a-b93e-a9c0b1a06c3d tempest-VolumesActionsTest-1673967414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:18 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e Jul 08 01:19:18 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:19 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4456be26-4d99-412a-b93e-a9c0b1a06c3d tempest-VolumesActionsTest-1673967414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e" returned: 0 in 1.067s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:19 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-4456be26-4d99-412a-b93e-a9c0b1a06c3d tempest-VolumesActionsTest-1673967414 None] Image conversion details: src /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e, size 1024.00 MB, duration 8.42 sec, destination /opt/stack/data/cinder/conversion/63661f0e-c7fe-4b7d-9588-c5e433b0b45e.temp_image.d13561ac-21b1-4975-9852-7d8a26c636415fel_8t1.img {{(pid=87022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:19:19 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-4456be26-4d99-412a-b93e-a9c0b1a06c3d tempest-VolumesActionsTest-1673967414 None] Converted 1024.00 MB image at 121.62 MB/s Jul 08 01:19:19 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-4456be26-4d99-412a-b93e-a9c0b1a06c3d tempest-VolumesActionsTest-1673967414 None] d13561ac-21b1-4975-9852-7d8a26c63641 was raw, converting to qcow2 {{(pid=87022) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 08 01:19:19 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a5b792-a6c6-44d2-8614-98426332d8a4]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:19:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4456be26-4d99-412a-b93e-a9c0b1a06c3d tempest-VolumesActionsTest-1673967414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/63661f0e-c7fe-4b7d-9588-c5e433b0b45e.temp_image.d13561ac-21b1-4975-9852-7d8a26c636415fel_8t1.img {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:19 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/63661f0e-c7fe-4b7d-9588-c5e433b0b45e.temp_image.d13561ac-21b1-4975-9852-7d8a26c636415fel_8t1.img Jul 08 01:19:19 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:19 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4456be26-4d99-412a-b93e-a9c0b1a06c3d tempest-VolumesActionsTest-1673967414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/63661f0e-c7fe-4b7d-9588-c5e433b0b45e.temp_image.d13561ac-21b1-4975-9852-7d8a26c636415fel_8t1.img" returned: 0 in 0.741s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4456be26-4d99-412a-b93e-a9c0b1a06c3d tempest-VolumesActionsTest-1673967414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/63661f0e-c7fe-4b7d-9588-c5e433b0b45e.temp_image.d13561ac-21b1-4975-9852-7d8a26c636415fel_8t1.img {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:20 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/63661f0e-c7fe-4b7d-9588-c5e433b0b45e.temp_image.d13561ac-21b1-4975-9852-7d8a26c636415fel_8t1.img Jul 08 01:19:20 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:20 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4456be26-4d99-412a-b93e-a9c0b1a06c3d tempest-VolumesActionsTest-1673967414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/63661f0e-c7fe-4b7d-9588-c5e433b0b45e.temp_image.d13561ac-21b1-4975-9852-7d8a26c636415fel_8t1.img" returned: 1 in 0.751s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4456be26-4d99-412a-b93e-a9c0b1a06c3d tempest-VolumesActionsTest-1673967414 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/63661f0e-c7fe-4b7d-9588-c5e433b0b45e.temp_image.d13561ac-21b1-4975-9852-7d8a26c636415fel_8t1.img' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:19:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4456be26-4d99-412a-b93e-a9c0b1a06c3d tempest-VolumesActionsTest-1673967414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/63661f0e-c7fe-4b7d-9588-c5e433b0b45e.temp_image.d13561ac-21b1-4975-9852-7d8a26c636415fel_8t1.img /opt/stack/data/cinder/conversion/vol_upload_pfdom3hd {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:20 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/63661f0e-c7fe-4b7d-9588-c5e433b0b45e.temp_image.d13561ac-21b1-4975-9852-7d8a26c636415fel_8t1.img /opt/stack/data/cinder/conversion/vol_upload_pfdom3hd Jul 08 01:19:20 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:21 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4456be26-4d99-412a-b93e-a9c0b1a06c3d tempest-VolumesActionsTest-1673967414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/63661f0e-c7fe-4b7d-9588-c5e433b0b45e.temp_image.d13561ac-21b1-4975-9852-7d8a26c636415fel_8t1.img /opt/stack/data/cinder/conversion/vol_upload_pfdom3hd" returned: 0 in 0.672s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:21 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-4456be26-4d99-412a-b93e-a9c0b1a06c3d tempest-VolumesActionsTest-1673967414 None] Image conversion details: src /opt/stack/data/cinder/conversion/63661f0e-c7fe-4b7d-9588-c5e433b0b45e.temp_image.d13561ac-21b1-4975-9852-7d8a26c636415fel_8t1.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_pfdom3hd {{(pid=87022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:19:21 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-4456be26-4d99-412a-b93e-a9c0b1a06c3d tempest-VolumesActionsTest-1673967414 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 08 01:19:21 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9f726d-ec8b-4f70-8ee4-9bd43c2a7534]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:19:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4456be26-4d99-412a-b93e-a9c0b1a06c3d tempest-VolumesActionsTest-1673967414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pfdom3hd {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:21 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pfdom3hd Jul 08 01:19:21 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:22 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4456be26-4d99-412a-b93e-a9c0b1a06c3d tempest-VolumesActionsTest-1673967414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pfdom3hd" returned: 0 in 0.763s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4456be26-4d99-412a-b93e-a9c0b1a06c3d tempest-VolumesActionsTest-1673967414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 16.544s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4456be26-4d99-412a-b93e-a9c0b1a06c3d tempest-VolumesActionsTest-1673967414 None] Uploaded volume to glance image-id: d13561ac-21b1-4975-9852-7d8a26c63641. {{(pid=87022) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 01:19:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.583s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1718048234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b80c86c5-7f2c-47c4-91de-40a789f208d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e2058be18b4e1ea8e3ee19bc073321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:19:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:19:09Z,use_quota=True,user_id='1275a54faecc48f68a817b3e2d2eb88e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:19:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Creating volume b80c86c5-7f2c-47c4-91de-40a789f208d4 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:19:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:19:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:19:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:19:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:19:23 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:19:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4 2147483648 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:23 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:UPDATE=67,cinder:SELECT=43,cinder:DELETE=7,cinder:INSERT=15 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:19:24 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4 2147483648 Jul 08 01:19:24 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-4456be26-4d99-412a-b93e-a9c0b1a06c3d tempest-VolumesActionsTest-1673967414 None] Copy volume to image completed successfully. Jul 08 01:19:24 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:25 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4 2147483648" returned: 0 in 1.043s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:25 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4 Jul 08 01:19:25 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-109d90c7-dbc4-4d81-a742-280a1df934a8 tempest-VolumesActionsTest-1673967414 None] Acquiring lock "cinder-63661f0e-c7fe-4b7d-9588-c5e433b0b45e-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:19:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-109d90c7-dbc4-4d81-a742-280a1df934a8 tempest-VolumesActionsTest-1673967414 None] Lock "cinder-63661f0e-c7fe-4b7d-9588-c5e433b0b45e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:19:25 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4" returned: 0 in 0.800s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:19:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.908s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9565eb8b-f021-4ed9-b69b-241c82e3e141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b80c86c5-7f2c-47c4-91de-40a789f208d4', 'volume_size': 2}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:19:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd950431-80a0-49cf-8fd6-9ba44603cd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:19:25 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Volume volume-b80c86c5-7f2c-47c4-91de-40a789f208d4 (b80c86c5-7f2c-47c4-91de-40a789f208d4): created successfully Jul 08 01:19:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd950431-80a0-49cf-8fd6-9ba44603cd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:19:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Flow 'volume_create_manager' (d48c0ea1-0013-4186-ac9c-06905acabe06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:19:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-109d90c7-dbc4-4d81-a742-280a1df934a8 tempest-VolumesActionsTest-1673967414 None] Acquiring lock "cinder-quobyte-63661f0e-c7fe-4b7d-9588-c5e433b0b45e" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:19:25 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-362087ba-2f72-476a-8b84-50284560339f tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Created volume successfully. Jul 08 01:19:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-109d90c7-dbc4-4d81-a742-280a1df934a8 tempest-VolumesActionsTest-1673967414 None] Lock "cinder-quobyte-63661f0e-c7fe-4b7d-9588-c5e433b0b45e" acquired by "delete_volume" :: waited 0.042s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:19:26 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdb9b70-7dc3-4141-9afa-e7a741d707b7]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:19:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-109d90c7-dbc4-4d81-a742-280a1df934a8 tempest-VolumesActionsTest-1673967414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:26 devstack sudo[99007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e Jul 08 01:19:26 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-53815ce4-f6c6-4034-9db7-cf9c3ed826f1 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:19:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-53815ce4-f6c6-4034-9db7-cf9c3ed826f1 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:26 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-53815ce4-f6c6-4034-9db7-cf9c3ed826f1 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Creating offline snapshot b7a2809c-872a-4b38-a767-86c30d844353 of volume b80c86c5-7f2c-47c4-91de-40a789f208d4 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:19:26 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a1c992-3c7c-4249-88a6-57efb4a6e74e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:19:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-53815ce4-f6c6-4034-9db7-cf9c3ed826f1 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:26 devstack sudo[99009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4 Jul 08 01:19:26 devstack sudo[99009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:27 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-109d90c7-dbc4-4d81-a742-280a1df934a8 tempest-VolumesActionsTest-1673967414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e" returned: 0 in 1.028s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-109d90c7-dbc4-4d81-a742-280a1df934a8 tempest-VolumesActionsTest-1673967414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:27 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e Jul 08 01:19:27 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:28 devstack sudo[99009]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-53815ce4-f6c6-4034-9db7-cf9c3ed826f1 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4" returned: 0 in 1.452s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-53815ce4-f6c6-4034-9db7-cf9c3ed826f1 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4.b7a2809c-872a-4b38-a767-86c30d844353 2G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:28 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4.b7a2809c-872a-4b38-a767-86c30d844353 2G Jul 08 01:19:28 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:28 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-109d90c7-dbc4-4d81-a742-280a1df934a8 tempest-VolumesActionsTest-1673967414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63661f0e-c7fe-4b7d-9588-c5e433b0b45e" returned: 0 in 1.214s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-109d90c7-dbc4-4d81-a742-280a1df934a8 tempest-VolumesActionsTest-1673967414 None] Lock "cinder-quobyte-63661f0e-c7fe-4b7d-9588-c5e433b0b45e" released by "delete_volume" :: held 2.303s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:19:28 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-109d90c7-dbc4-4d81-a742-280a1df934a8 tempest-VolumesActionsTest-1673967414 None] Created reservations ['edefc187-0941-4429-8890-f4f019696020', 'f051fa60-e8e7-49e6-b633-dbaa1df62807', 'cfe78b41-a026-49c8-bc53-ffbeacfe2a50', 'dca16abd-fa52-4d63-8070-c11e0795251c'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:19:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-109d90c7-dbc4-4d81-a742-280a1df934a8 tempest-VolumesActionsTest-1673967414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:19:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-109d90c7-dbc4-4d81-a742-280a1df934a8 tempest-VolumesActionsTest-1673967414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:28 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-109d90c7-dbc4-4d81-a742-280a1df934a8 tempest-VolumesActionsTest-1673967414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:19:28 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-109d90c7-dbc4-4d81-a742-280a1df934a8 tempest-VolumesActionsTest-1673967414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:19:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-109d90c7-dbc4-4d81-a742-280a1df934a8 tempest-VolumesActionsTest-1673967414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-109d90c7-dbc4-4d81-a742-280a1df934a8 tempest-VolumesActionsTest-1673967414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:28 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:19:28 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:28 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-53815ce4-f6c6-4034-9db7-cf9c3ed826f1 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4.b7a2809c-872a-4b38-a767-86c30d844353 2G" returned: 0 in 0.968s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-53815ce4-f6c6-4034-9db7-cf9c3ed826f1 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b80c86c5-7f2c-47c4-91de-40a789f208d4 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4.b7a2809c-872a-4b38-a767-86c30d844353 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:29 devstack sudo[99029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b80c86c5-7f2c-47c4-91de-40a789f208d4 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4.b7a2809c-872a-4b38-a767-86c30d844353 Jul 08 01:19:29 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:29 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-109d90c7-dbc4-4d81-a742-280a1df934a8 tempest-VolumesActionsTest-1673967414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.740s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:29 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-109d90c7-dbc4-4d81-a742-280a1df934a8 tempest-VolumesActionsTest-1673967414 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:19:29 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-109d90c7-dbc4-4d81-a742-280a1df934a8 tempest-VolumesActionsTest-1673967414 None] Deleted volume successfully. Jul 08 01:19:29 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-109d90c7-dbc4-4d81-a742-280a1df934a8 tempest-VolumesActionsTest-1673967414 None] Lock "cinder-63661f0e-c7fe-4b7d-9588-c5e433b0b45e-delete_volume" released by "delete_volume" :: held 3.414s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:19:29 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-53815ce4-f6c6-4034-9db7-cf9c3ed826f1 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b80c86c5-7f2c-47c4-91de-40a789f208d4 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4.b7a2809c-872a-4b38-a767-86c30d844353" returned: 0 in 0.749s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:29 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-53815ce4-f6c6-4034-9db7-cf9c3ed826f1 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4.b7a2809c-872a-4b38-a767-86c30d844353 is being set with open permissions: ugo+rw Jul 08 01:19:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-53815ce4-f6c6-4034-9db7-cf9c3ed826f1 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4.b7a2809c-872a-4b38-a767-86c30d844353 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:29 devstack sudo[99040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4.b7a2809c-872a-4b38-a767-86c30d844353 Jul 08 01:19:29 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:30 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-53815ce4-f6c6-4034-9db7-cf9c3ed826f1 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4.b7a2809c-872a-4b38-a767-86c30d844353" returned: 0 in 0.920s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-53815ce4-f6c6-4034-9db7-cf9c3ed826f1 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:30 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4.info Jul 08 01:19:30 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:31 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-53815ce4-f6c6-4034-9db7-cf9c3ed826f1 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4.info" returned: 0 in 0.754s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:31 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-53815ce4-f6c6-4034-9db7-cf9c3ed826f1 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4.info is being set with open permissions: ugo+rw Jul 08 01:19:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-53815ce4-f6c6-4034-9db7-cf9c3ed826f1 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:31 devstack sudo[99071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4.info Jul 08 01:19:31 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:32 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-53815ce4-f6c6-4034-9db7-cf9c3ed826f1 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4.info" returned: 0 in 0.728s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-53815ce4-f6c6-4034-9db7-cf9c3ed826f1 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.713s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:32 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-53815ce4-f6c6-4034-9db7-cf9c3ed826f1 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Create snapshot completed successfully Jul 08 01:19:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4cfed8c8-7fb4-4d74-85ef-18589860071a tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Acquiring lock "cinder-b7a2809c-872a-4b38-a767-86c30d844353-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:19:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4cfed8c8-7fb4-4d74-85ef-18589860071a tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Lock "cinder-b7a2809c-872a-4b38-a767-86c30d844353-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:19:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4cfed8c8-7fb4-4d74-85ef-18589860071a tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Acquiring lock "cinder-quobyte-b80c86c5-7f2c-47c4-91de-40a789f208d4" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:19:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4cfed8c8-7fb4-4d74-85ef-18589860071a tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Lock "cinder-quobyte-b80c86c5-7f2c-47c4-91de-40a789f208d4" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:19:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4cfed8c8-7fb4-4d74-85ef-18589860071a tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Acquiring lock "cinder-quobyte-b7a2809c-872a-4b38-a767-86c30d844353" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:19:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4cfed8c8-7fb4-4d74-85ef-18589860071a tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Lock "cinder-quobyte-b7a2809c-872a-4b38-a767-86c30d844353" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:19:33 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-4cfed8c8-7fb4-4d74-85ef-18589860071a tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Deleting offline snapshot b7a2809c-872a-4b38-a767-86c30d844353 of volume b80c86c5-7f2c-47c4-91de-40a789f208d4 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:19:33 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-4cfed8c8-7fb4-4d74-85ef-18589860071a tempest-VolumesSnapshotNegativeTestJSON-48957739 None] snapshot_file for this snap is: volume-b80c86c5-7f2c-47c4-91de-40a789f208d4.b7a2809c-872a-4b38-a767-86c30d844353 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:19:33 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8111a9-cbac-483c-a858-1ad238d7805b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:19:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4cfed8c8-7fb4-4d74-85ef-18589860071a tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4.b7a2809c-872a-4b38-a767-86c30d844353 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:33 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4.b7a2809c-872a-4b38-a767-86c30d844353 Jul 08 01:19:33 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:34 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4cfed8c8-7fb4-4d74-85ef-18589860071a tempest-VolumesSnapshotNegativeTestJSON-48957739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4.b7a2809c-872a-4b38-a767-86c30d844353" returned: 0 in 0.995s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:34 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-4cfed8c8-7fb4-4d74-85ef-18589860071a tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b80c86c5-7f2c-47c4-91de-40a789f208d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:19:34 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[e618bcef-a61d-4e3c-9fbf-b54834191d95]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:19:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4cfed8c8-7fb4-4d74-85ef-18589860071a tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-7f3a78c8-878c-45df-b4d7-66f05586affe req-9feda89b-38ad-4fa8-beca-67aa67af15be tempest-TestServerVolumeAttachmentScenario-168066397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:19:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-7f3a78c8-878c-45df-b4d7-66f05586affe req-9feda89b-38ad-4fa8-beca-67aa67af15be tempest-TestServerVolumeAttachmentScenario-168066397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:34 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efb012c-b6ae-4648-b634-2f4b13d3038c]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:19:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-7f3a78c8-878c-45df-b4d7-66f05586affe req-9feda89b-38ad-4fa8-beca-67aa67af15be tempest-TestServerVolumeAttachmentScenario-168066397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-47051ab9-b825-4531-a212-2fcb7e5f26af {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:34 devstack sudo[99088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4 Jul 08 01:19:34 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:34 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-47051ab9-b825-4531-a212-2fcb7e5f26af Jul 08 01:19:34 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:35 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4cfed8c8-7fb4-4d74-85ef-18589860071a tempest-VolumesSnapshotNegativeTestJSON-48957739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4" returned: 0 in 1.058s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4cfed8c8-7fb4-4d74-85ef-18589860071a tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4.b7a2809c-872a-4b38-a767-86c30d844353 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:35 devstack sudo[99098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4.b7a2809c-872a-4b38-a767-86c30d844353 Jul 08 01:19:35 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:35 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-7f3a78c8-878c-45df-b4d7-66f05586affe req-9feda89b-38ad-4fa8-beca-67aa67af15be tempest-TestServerVolumeAttachmentScenario-168066397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-47051ab9-b825-4531-a212-2fcb7e5f26af" returned: 0 in 1.032s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-7f3a78c8-878c-45df-b4d7-66f05586affe req-9feda89b-38ad-4fa8-beca-67aa67af15be tempest-TestServerVolumeAttachmentScenario-168066397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.054s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:35 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-7f3a78c8-878c-45df-b4d7-66f05586affe req-9feda89b-38ad-4fa8-beca-67aa67af15be tempest-TestServerVolumeAttachmentScenario-168066397 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d', 'name': 'volume-47051ab9-b825-4531-a212-2fcb7e5f26af', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0627e118-0dc7-426a-b1df-b03d87778a8e', 'enforce_multipath': True} {{(pid=87022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:19:35 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-7f3a78c8-878c-45df-b4d7-66f05586affe req-9feda89b-38ad-4fa8-beca-67aa67af15be tempest-TestServerVolumeAttachmentScenario-168066397 None] attachment_update completed successfully. Jul 08 01:19:36 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4cfed8c8-7fb4-4d74-85ef-18589860071a tempest-VolumesSnapshotNegativeTestJSON-48957739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4.b7a2809c-872a-4b38-a767-86c30d844353" returned: 0 in 0.968s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4cfed8c8-7fb4-4d74-85ef-18589860071a tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4.b7a2809c-872a-4b38-a767-86c30d844353 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:36 devstack sudo[99170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4.b7a2809c-872a-4b38-a767-86c30d844353 Jul 08 01:19:36 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:36 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4cfed8c8-7fb4-4d74-85ef-18589860071a tempest-VolumesSnapshotNegativeTestJSON-48957739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4.b7a2809c-872a-4b38-a767-86c30d844353" returned: 0 in 0.746s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:36 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4cfed8c8-7fb4-4d74-85ef-18589860071a tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Lock "cinder-quobyte-b7a2809c-872a-4b38-a767-86c30d844353" released by "_delete_snapshot" :: held 3.896s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:19:36 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4cfed8c8-7fb4-4d74-85ef-18589860071a tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Lock "cinder-quobyte-b80c86c5-7f2c-47c4-91de-40a789f208d4" released by "delete_snapshot" :: held 3.928s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:19:37 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-4cfed8c8-7fb4-4d74-85ef-18589860071a tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Created reservations ['01289ce8-f5e7-4b85-86d3-1fa08d691462', 'cbc326c6-62d8-4798-bf70-7326144c4017', '5c12088d-41bb-4227-af65-7e9f46b5e57a', 'a463aaa4-175d-4620-9443-2cbb513230e5'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:19:37 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-4cfed8c8-7fb4-4d74-85ef-18589860071a tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Delete snapshot completed successfully. Jul 08 01:19:37 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4cfed8c8-7fb4-4d74-85ef-18589860071a tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Lock "cinder-b7a2809c-872a-4b38-a767-86c30d844353-delete_snapshot" released by "delete_snapshot" :: held 4.101s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:19:37 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-58363104-dca7-4458-8bb7-6fcd5adc7ef3 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Acquiring lock "cinder-b80c86c5-7f2c-47c4-91de-40a789f208d4-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:19:37 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-58363104-dca7-4458-8bb7-6fcd5adc7ef3 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Lock "cinder-b80c86c5-7f2c-47c4-91de-40a789f208d4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:19:37 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-58363104-dca7-4458-8bb7-6fcd5adc7ef3 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Acquiring lock "cinder-quobyte-b80c86c5-7f2c-47c4-91de-40a789f208d4" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:19:37 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-58363104-dca7-4458-8bb7-6fcd5adc7ef3 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Lock "cinder-quobyte-b80c86c5-7f2c-47c4-91de-40a789f208d4" acquired by "delete_volume" :: waited 0.018s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:19:37 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a5a817-46f7-4dc4-9c67-385d6dcf3989]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:19:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-58363104-dca7-4458-8bb7-6fcd5adc7ef3 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:37 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4 Jul 08 01:19:37 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:38 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-58363104-dca7-4458-8bb7-6fcd5adc7ef3 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4" returned: 0 in 0.921s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-58363104-dca7-4458-8bb7-6fcd5adc7ef3 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:38 devstack sudo[99496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4 Jul 08 01:19:38 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:39 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-58363104-dca7-4458-8bb7-6fcd5adc7ef3 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b80c86c5-7f2c-47c4-91de-40a789f208d4" returned: 0 in 0.748s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:39 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-58363104-dca7-4458-8bb7-6fcd5adc7ef3 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Lock "cinder-quobyte-b80c86c5-7f2c-47c4-91de-40a789f208d4" released by "delete_volume" :: held 1.747s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:19:39 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-58363104-dca7-4458-8bb7-6fcd5adc7ef3 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Created reservations ['0a27a0e8-9283-45f5-b17d-5569a1618937', 'ea832109-7907-42e2-ab1a-c153dada3fdf', 'f50fb24d-a1f1-40c2-b28d-078134d5cf67', '3926c126-13fd-43e7-9d52-9f8c1c04c175'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:19:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-58363104-dca7-4458-8bb7-6fcd5adc7ef3 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:19:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-58363104-dca7-4458-8bb7-6fcd5adc7ef3 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:39 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-58363104-dca7-4458-8bb7-6fcd5adc7ef3 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:19:39 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-58363104-dca7-4458-8bb7-6fcd5adc7ef3 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:19:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-58363104-dca7-4458-8bb7-6fcd5adc7ef3 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-58363104-dca7-4458-8bb7-6fcd5adc7ef3 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:39 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:19:39 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:40 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-58363104-dca7-4458-8bb7-6fcd5adc7ef3 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.984s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:40 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-58363104-dca7-4458-8bb7-6fcd5adc7ef3 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:19:40 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-58363104-dca7-4458-8bb7-6fcd5adc7ef3 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Deleted volume successfully. Jul 08 01:19:40 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-58363104-dca7-4458-8bb7-6fcd5adc7ef3 tempest-VolumesSnapshotNegativeTestJSON-48957739 None] Lock "cinder-b80c86c5-7f2c-47c4-91de-40a789f208d4-delete_volume" released by "delete_volume" :: held 3.025s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:19:43 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ee6d34ec-de46-4ad5-b3d6-45575991a26f tempest-VolumesNegativeTest-71153331 None] Acquiring lock "cinder-1823ee5e-297d-4da1-a7f1-08324c562de1-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:19:43 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ee6d34ec-de46-4ad5-b3d6-45575991a26f tempest-VolumesNegativeTest-71153331 None] Lock "cinder-1823ee5e-297d-4da1-a7f1-08324c562de1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:19:43 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ee6d34ec-de46-4ad5-b3d6-45575991a26f tempest-VolumesNegativeTest-71153331 None] Acquiring lock "cinder-quobyte-1823ee5e-297d-4da1-a7f1-08324c562de1" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:19:43 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ee6d34ec-de46-4ad5-b3d6-45575991a26f tempest-VolumesNegativeTest-71153331 None] Lock "cinder-quobyte-1823ee5e-297d-4da1-a7f1-08324c562de1" acquired by "delete_volume" :: waited 0.025s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:19:43 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a425fc4a-3ba9-49c9-b84f-1be665b804a0]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:19:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ee6d34ec-de46-4ad5-b3d6-45575991a26f tempest-VolumesNegativeTest-71153331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1823ee5e-297d-4da1-a7f1-08324c562de1 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:43 devstack sudo[99502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1823ee5e-297d-4da1-a7f1-08324c562de1 Jul 08 01:19:43 devstack sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:44 devstack sudo[99502]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ee6d34ec-de46-4ad5-b3d6-45575991a26f tempest-VolumesNegativeTest-71153331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1823ee5e-297d-4da1-a7f1-08324c562de1" returned: 0 in 1.037s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ee6d34ec-de46-4ad5-b3d6-45575991a26f tempest-VolumesNegativeTest-71153331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1823ee5e-297d-4da1-a7f1-08324c562de1 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:44 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1823ee5e-297d-4da1-a7f1-08324c562de1 Jul 08 01:19:44 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:45 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ee6d34ec-de46-4ad5-b3d6-45575991a26f tempest-VolumesNegativeTest-71153331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1823ee5e-297d-4da1-a7f1-08324c562de1" returned: 0 in 0.783s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:45 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ee6d34ec-de46-4ad5-b3d6-45575991a26f tempest-VolumesNegativeTest-71153331 None] Lock "cinder-quobyte-1823ee5e-297d-4da1-a7f1-08324c562de1" released by "delete_volume" :: held 1.879s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:19:45 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-ee6d34ec-de46-4ad5-b3d6-45575991a26f tempest-VolumesNegativeTest-71153331 None] Created reservations ['14d14999-03b4-4228-b22c-d38b2bab6cfe', '90ce6967-d33a-4649-a072-15ce4ad9fd4c', '467430f0-33c9-42dd-8a38-683722b8fb78', 'd6c4aa85-90c8-4096-baa3-36eb65465afe'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:19:45 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:19:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:19:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:19:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:19:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ee6d34ec-de46-4ad5-b3d6-45575991a26f tempest-VolumesNegativeTest-71153331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:19:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ee6d34ec-de46-4ad5-b3d6-45575991a26f tempest-VolumesNegativeTest-71153331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ee6d34ec-de46-4ad5-b3d6-45575991a26f tempest-VolumesNegativeTest-71153331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:19:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ee6d34ec-de46-4ad5-b3d6-45575991a26f tempest-VolumesNegativeTest-71153331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:19:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ee6d34ec-de46-4ad5-b3d6-45575991a26f tempest-VolumesNegativeTest-71153331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ee6d34ec-de46-4ad5-b3d6-45575991a26f tempest-VolumesNegativeTest-71153331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:45 devstack sudo[99513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:19:45 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:45 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:19:45 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:46 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.797s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:46 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:19:46 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:19:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread count: 28 {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:19:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread info: [<_MainThread(MainThread, started 134382216167552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:19:46 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ee6d34ec-de46-4ad5-b3d6-45575991a26f tempest-VolumesNegativeTest-71153331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.882s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:46 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-ee6d34ec-de46-4ad5-b3d6-45575991a26f tempest-VolumesNegativeTest-71153331 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:19:46 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-ee6d34ec-de46-4ad5-b3d6-45575991a26f tempest-VolumesNegativeTest-71153331 None] Deleted volume successfully. Jul 08 01:19:46 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ee6d34ec-de46-4ad5-b3d6-45575991a26f tempest-VolumesNegativeTest-71153331 None] Lock "cinder-1823ee5e-297d-4da1-a7f1-08324c562de1-delete_volume" released by "delete_volume" :: held 3.081s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:19:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-ffef7cd2-fe64-4da4-9f1f-090201ab309c req-d5fe7456-2a56-49f5-890f-2de4b3c05357 tempest-TestServerVolumeAttachmentScenario-168066397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:19:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-ffef7cd2-fe64-4da4-9f1f-090201ab309c req-d5fe7456-2a56-49f5-890f-2de4b3c05357 tempest-TestServerVolumeAttachmentScenario-168066397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:47 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[725aa2a7-72f1-4d34-8bb1-fda6276bfba5]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:19:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-ffef7cd2-fe64-4da4-9f1f-090201ab309c req-d5fe7456-2a56-49f5-890f-2de4b3c05357 tempest-TestServerVolumeAttachmentScenario-168066397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a61a12f6-2389-4a20-a03b-0b2a058e27b2 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:48 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a61a12f6-2389-4a20-a03b-0b2a058e27b2 Jul 08 01:19:48 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:49 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-ffef7cd2-fe64-4da4-9f1f-090201ab309c req-d5fe7456-2a56-49f5-890f-2de4b3c05357 tempest-TestServerVolumeAttachmentScenario-168066397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a61a12f6-2389-4a20-a03b-0b2a058e27b2" returned: 0 in 1.191s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-ffef7cd2-fe64-4da4-9f1f-090201ab309c req-d5fe7456-2a56-49f5-890f-2de4b3c05357 tempest-TestServerVolumeAttachmentScenario-168066397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.218s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-ffef7cd2-fe64-4da4-9f1f-090201ab309c req-d5fe7456-2a56-49f5-890f-2de4b3c05357 tempest-TestServerVolumeAttachmentScenario-168066397 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d', 'name': 'volume-a61a12f6-2389-4a20-a03b-0b2a058e27b2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b818088-c4e5-42a4-8001-618c376e3268', 'enforce_multipath': True} {{(pid=87022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:19:49 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-ffef7cd2-fe64-4da4-9f1f-090201ab309c req-d5fe7456-2a56-49f5-890f-2de4b3c05357 tempest-TestServerVolumeAttachmentScenario-168066397 None] attachment_update completed successfully. Jul 08 01:19:55 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:19:56 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Flow 'volume_create_manager' (32f2536a-13b8-44cb-a82c-2ca47b3e2b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:19:56 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9ed1c8e-d7d3-4de8-8e8b-869f7de87a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:19:56 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-d23380b6-ce84-4272-9b04-39fdab10cd8b req-de138575-ab3a-47c5-920d-6b99bcdacf38 tempest-TestServerVolumeAttachmentScenario-168066397 None] Terminate volume connection completed successfully. Jul 08 01:19:56 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-d23380b6-ce84-4272-9b04-39fdab10cd8b req-de138575-ab3a-47c5-920d-6b99bcdacf38 tempest-TestServerVolumeAttachmentScenario-168066397 None] Deleting attachment 5b818088-c4e5-42a4-8001-618c376e3268. {{(pid=87022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:19:56 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9ed1c8e-d7d3-4de8-8e8b-869f7de87a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-77859361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3c27c6f-fcbc-4b40-a766-aa7e96e05888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b58dc8aa4847f2a6b2736b96ac6c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:19:56Z,use_quota=True,user_id='e8bebc9f0edd4842b7f8c8e87e0e0beb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:19:56 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ffe249d-db77-4bb6-907a-1fbefabaca4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:19:56 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ffe249d-db77-4bb6-907a-1fbefabaca4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:19:56 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c80c531-7094-4100-a07c-39ddc77169b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:19:56 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c80c531-7094-4100-a07c-39ddc77169b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3c27c6f-fcbc-4b40-a766-aa7e96e05888', 'volume_name': 'volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:19:56 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02af3f1c-4e27-4373-aa7d-2ba4e2347f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:19:56 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02af3f1c-4e27-4373-aa7d-2ba4e2347f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:19:56 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d7f80e-5580-4360-9579-7dce41c7725f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:19:56 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Volume f3c27c6f-fcbc-4b40-a766-aa7e96e05888: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888', 'volume_size': 1} Jul 08 01:19:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:19:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:56 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-77859361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3c27c6f-fcbc-4b40-a766-aa7e96e05888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b58dc8aa4847f2a6b2736b96ac6c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:19:56Z,use_quota=True,user_id='e8bebc9f0edd4842b7f8c8e87e0e0beb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:19:56 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Creating volume f3c27c6f-fcbc-4b40-a766-aa7e96e05888 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:19:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:19:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:56 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:19:56 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:19:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:56 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:19:56 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:19:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:56 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888 1073741824 Jul 08 01:19:56 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:57 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888 1073741824" returned: 0 in 1.192s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:57 devstack sudo[99569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888 Jul 08 01:19:57 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:58 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888" returned: 0 in 0.888s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] <== create_volume: return (2156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:19:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.160s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d7f80e-5580-4360-9579-7dce41c7725f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:19:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (160cf7cd-7f2a-410a-b128-d84ee2c34135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:19:58 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Volume volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888 (f3c27c6f-fcbc-4b40-a766-aa7e96e05888): created successfully Jul 08 01:19:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (160cf7cd-7f2a-410a-b128-d84ee2c34135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:19:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Flow 'volume_create_manager' (32f2536a-13b8-44cb-a82c-2ca47b3e2b83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:19:58 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-f1218605-3303-4e44-8a98-eb3ff71ca384 tempest-VolumesSnapshotTestJSON-1641979681 None] Created volume successfully. Jul 08 01:19:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a3b0dc25-8c0e-4953-99c6-db85a833d469 tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:19:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a3b0dc25-8c0e-4953-99c6-db85a833d469 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-a3b0dc25-8c0e-4953-99c6-db85a833d469 tempest-VolumesSnapshotTestJSON-1641979681 None] Creating offline snapshot d03da534-049c-4203-b3c5-3183df48e292 of volume f3c27c6f-fcbc-4b40-a766-aa7e96e05888 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:19:59 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f5e4d7-f29d-4e85-bc52-0b92d93f53c7]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:19:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a3b0dc25-8c0e-4953-99c6-db85a833d469 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:59 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888 Jul 08 01:19:59 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:00 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-1f0110a4-e76d-477a-aa5d-6adcfd61e41e req-fd01eef1-8899-44b6-a237-daf441e2ae2e tempest-TestServerVolumeAttachmentScenario-168066397 None] Terminate volume connection completed successfully. Jul 08 01:20:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-1f0110a4-e76d-477a-aa5d-6adcfd61e41e req-fd01eef1-8899-44b6-a237-daf441e2ae2e tempest-TestServerVolumeAttachmentScenario-168066397 None] Deleting attachment 0627e118-0dc7-426a-b1df-b03d87778a8e. {{(pid=87022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:20:00 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a3b0dc25-8c0e-4953-99c6-db85a833d469 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888" returned: 0 in 1.123s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a3b0dc25-8c0e-4953-99c6-db85a833d469 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888.d03da534-049c-4203-b3c5-3183df48e292 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:00 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888.d03da534-049c-4203-b3c5-3183df48e292 1G Jul 08 01:20:00 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:02 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a3b0dc25-8c0e-4953-99c6-db85a833d469 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888.d03da534-049c-4203-b3c5-3183df48e292 1G" returned: 0 in 1.207s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a3b0dc25-8c0e-4953-99c6-db85a833d469 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888.d03da534-049c-4203-b3c5-3183df48e292 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:02 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888.d03da534-049c-4203-b3c5-3183df48e292 Jul 08 01:20:02 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:03 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a3b0dc25-8c0e-4953-99c6-db85a833d469 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888.d03da534-049c-4203-b3c5-3183df48e292" returned: 0 in 1.172s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:03 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-a3b0dc25-8c0e-4953-99c6-db85a833d469 tempest-VolumesSnapshotTestJSON-1641979681 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888.d03da534-049c-4203-b3c5-3183df48e292 is being set with open permissions: ugo+rw Jul 08 01:20:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a3b0dc25-8c0e-4953-99c6-db85a833d469 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888.d03da534-049c-4203-b3c5-3183df48e292 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:03 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888.d03da534-049c-4203-b3c5-3183df48e292 Jul 08 01:20:03 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:04 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a3b0dc25-8c0e-4953-99c6-db85a833d469 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888.d03da534-049c-4203-b3c5-3183df48e292" returned: 0 in 0.928s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:04 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:UPDATE=49,cinder:SELECT=47,cinder:DELETE=4,cinder:INSERT=12 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:20:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a3b0dc25-8c0e-4953-99c6-db85a833d469 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:04 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888.info Jul 08 01:20:04 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:05 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a3b0dc25-8c0e-4953-99c6-db85a833d469 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888.info" returned: 0 in 1.014s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:05 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-a3b0dc25-8c0e-4953-99c6-db85a833d469 tempest-VolumesSnapshotTestJSON-1641979681 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888.info is being set with open permissions: ugo+rw Jul 08 01:20:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a3b0dc25-8c0e-4953-99c6-db85a833d469 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:05 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888.info Jul 08 01:20:05 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:06 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a3b0dc25-8c0e-4953-99c6-db85a833d469 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888.info" returned: 0 in 0.797s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a3b0dc25-8c0e-4953-99c6-db85a833d469 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.398s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:20:06 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-a3b0dc25-8c0e-4953-99c6-db85a833d469 tempest-VolumesSnapshotTestJSON-1641979681 None] Create snapshot completed successfully Jul 08 01:20:07 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-01c33d2f-df6d-49cf-a8ec-f4c5efd2f297 tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "cinder-d03da534-049c-4203-b3c5-3183df48e292-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:20:07 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-01c33d2f-df6d-49cf-a8ec-f4c5efd2f297 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-d03da534-049c-4203-b3c5-3183df48e292-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:20:07 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-01c33d2f-df6d-49cf-a8ec-f4c5efd2f297 tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "cinder-quobyte-f3c27c6f-fcbc-4b40-a766-aa7e96e05888" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:20:07 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-01c33d2f-df6d-49cf-a8ec-f4c5efd2f297 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-f3c27c6f-fcbc-4b40-a766-aa7e96e05888" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:20:07 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-01c33d2f-df6d-49cf-a8ec-f4c5efd2f297 tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "cinder-quobyte-d03da534-049c-4203-b3c5-3183df48e292" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:20:07 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-01c33d2f-df6d-49cf-a8ec-f4c5efd2f297 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-d03da534-049c-4203-b3c5-3183df48e292" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:20:07 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-01c33d2f-df6d-49cf-a8ec-f4c5efd2f297 tempest-VolumesSnapshotTestJSON-1641979681 None] Deleting offline snapshot d03da534-049c-4203-b3c5-3183df48e292 of volume f3c27c6f-fcbc-4b40-a766-aa7e96e05888 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:20:07 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-01c33d2f-df6d-49cf-a8ec-f4c5efd2f297 tempest-VolumesSnapshotTestJSON-1641979681 None] snapshot_file for this snap is: volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888.d03da534-049c-4203-b3c5-3183df48e292 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:20:07 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[755dbaa8-9b30-4fb0-8a4a-908ee943b106]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:20:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-01c33d2f-df6d-49cf-a8ec-f4c5efd2f297 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888.d03da534-049c-4203-b3c5-3183df48e292 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:07 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888.d03da534-049c-4203-b3c5-3183df48e292 Jul 08 01:20:07 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:08 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-01c33d2f-df6d-49cf-a8ec-f4c5efd2f297 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888.d03da534-049c-4203-b3c5-3183df48e292" returned: 0 in 1.077s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:08 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-01c33d2f-df6d-49cf-a8ec-f4c5efd2f297 tempest-VolumesSnapshotTestJSON-1641979681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:20:08 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a1c4f9-f00f-47f7-99b2-9e913d6a3b9e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:20:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-01c33d2f-df6d-49cf-a8ec-f4c5efd2f297 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:08 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888 Jul 08 01:20:08 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:09 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-01c33d2f-df6d-49cf-a8ec-f4c5efd2f297 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888" returned: 0 in 0.908s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-01c33d2f-df6d-49cf-a8ec-f4c5efd2f297 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888.d03da534-049c-4203-b3c5-3183df48e292 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:09 devstack sudo[99642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888.d03da534-049c-4203-b3c5-3183df48e292 Jul 08 01:20:09 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:10 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-01c33d2f-df6d-49cf-a8ec-f4c5efd2f297 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888.d03da534-049c-4203-b3c5-3183df48e292" returned: 0 in 1.140s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-01c33d2f-df6d-49cf-a8ec-f4c5efd2f297 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888.d03da534-049c-4203-b3c5-3183df48e292 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:10 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888.d03da534-049c-4203-b3c5-3183df48e292 Jul 08 01:20:10 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:11 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-01c33d2f-df6d-49cf-a8ec-f4c5efd2f297 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888.d03da534-049c-4203-b3c5-3183df48e292" returned: 0 in 0.871s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:11 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-01c33d2f-df6d-49cf-a8ec-f4c5efd2f297 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-d03da534-049c-4203-b3c5-3183df48e292" released by "_delete_snapshot" :: held 4.132s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:20:11 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-01c33d2f-df6d-49cf-a8ec-f4c5efd2f297 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-f3c27c6f-fcbc-4b40-a766-aa7e96e05888" released by "delete_snapshot" :: held 4.164s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:20:11 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-01c33d2f-df6d-49cf-a8ec-f4c5efd2f297 tempest-VolumesSnapshotTestJSON-1641979681 None] Created reservations ['e6c47e5e-26d5-4116-8421-b1295776f0ea', '12e46499-a76d-4788-b0e0-a73e537fcf41', 'c3858781-25b8-419b-8bde-ef7cb983adec', '299e6afe-8734-40ff-87b0-bfd64c3ad165'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:20:11 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-01c33d2f-df6d-49cf-a8ec-f4c5efd2f297 tempest-VolumesSnapshotTestJSON-1641979681 None] Delete snapshot completed successfully. Jul 08 01:20:11 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-01c33d2f-df6d-49cf-a8ec-f4c5efd2f297 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-d03da534-049c-4203-b3c5-3183df48e292-delete_snapshot" released by "delete_snapshot" :: held 4.381s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:20:13 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:20:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Flow 'volume_create_manager' (e3f3ca57-1b04-4cde-bf4d-27205bad0527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:20:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d42830e-a644-431e-ba5e-340158bdcd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d42830e-a644-431e-ba5e-340158bdcd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-984907760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6ecd855-7ea3-46a7-a0f1-f40122e85ba4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b58dc8aa4847f2a6b2736b96ac6c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:20:13Z,use_quota=True,user_id='e8bebc9f0edd4842b7f8c8e87e0e0beb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (007bb8b0-2fe9-41fd-8f92-2fecc675cd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (007bb8b0-2fe9-41fd-8f92-2fecc675cd13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (097b701a-e66c-4cb7-b962-9d74a7cff7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (097b701a-e66c-4cb7-b962-9d74a7cff7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6ecd855-7ea3-46a7-a0f1-f40122e85ba4', 'volume_name': 'volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7652028-ceb0-4933-a972-30704b28a3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7652028-ceb0-4933-a972-30704b28a3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d615db-f27f-40df-9f0d-6d8359dcc856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:13 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Volume b6ecd855-7ea3-46a7-a0f1-f40122e85ba4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4', 'volume_size': 1} Jul 08 01:20:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:20:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:20:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-984907760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6ecd855-7ea3-46a7-a0f1-f40122e85ba4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b58dc8aa4847f2a6b2736b96ac6c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:20:13Z,use_quota=True,user_id='e8bebc9f0edd4842b7f8c8e87e0e0beb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:20:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Creating volume b6ecd855-7ea3-46a7-a0f1-f40122e85ba4 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:20:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:20:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:20:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:20:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:20:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:20:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:20:13 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:20:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:13 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4 1073741824 Jul 08 01:20:13 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:14 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4 1073741824" returned: 0 in 1.119s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:14 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4 Jul 08 01:20:14 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:15 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4" returned: 0 in 0.776s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:15 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:20:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:20:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d615db-f27f-40df-9f0d-6d8359dcc856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c04b21-d609-4149-b90d-559cbf5ab778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:15 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Volume volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4 (b6ecd855-7ea3-46a7-a0f1-f40122e85ba4): created successfully Jul 08 01:20:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c04b21-d609-4149-b90d-559cbf5ab778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Flow 'volume_create_manager' (e3f3ca57-1b04-4cde-bf4d-27205bad0527) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:20:15 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-8b4c33de-547f-46b1-b904-512b298ebd9f tempest-VolumesSnapshotTestJSON-1641979681 None] Created volume successfully. Jul 08 01:20:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-14d91018-ecdd-4de2-8837-a536891008b6 tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:20:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-14d91018-ecdd-4de2-8837-a536891008b6 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:20:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-14d91018-ecdd-4de2-8837-a536891008b6 tempest-VolumesSnapshotTestJSON-1641979681 None] Creating offline snapshot a4907ddc-9545-48a6-a24c-8c61da7be8e4 of volume b6ecd855-7ea3-46a7-a0f1-f40122e85ba4 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:20:16 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf339de8-4329-4a9b-88fa-31c27c6f34f6]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:20:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-14d91018-ecdd-4de2-8837-a536891008b6 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:16 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4 Jul 08 01:20:16 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:17 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-14d91018-ecdd-4de2-8837-a536891008b6 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4" returned: 0 in 1.025s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-14d91018-ecdd-4de2-8837-a536891008b6 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.a4907ddc-9545-48a6-a24c-8c61da7be8e4 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:17 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.a4907ddc-9545-48a6-a24c-8c61da7be8e4 1G Jul 08 01:20:17 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2157846c-3b62-4384-aa02-2118ccb64197 tempest-TestServerVolumeAttachmentScenario-168066397 None] Acquiring lock "cinder-a61a12f6-2389-4a20-a03b-0b2a058e27b2-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:20:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2157846c-3b62-4384-aa02-2118ccb64197 tempest-TestServerVolumeAttachmentScenario-168066397 None] Lock "cinder-a61a12f6-2389-4a20-a03b-0b2a058e27b2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:20:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2157846c-3b62-4384-aa02-2118ccb64197 tempest-TestServerVolumeAttachmentScenario-168066397 None] Acquiring lock "cinder-quobyte-a61a12f6-2389-4a20-a03b-0b2a058e27b2" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:20:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2157846c-3b62-4384-aa02-2118ccb64197 tempest-TestServerVolumeAttachmentScenario-168066397 None] Lock "cinder-quobyte-a61a12f6-2389-4a20-a03b-0b2a058e27b2" acquired by "delete_volume" :: waited 0.028s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:20:18 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb646f09-b142-4822-bf5e-1289db4c77b5]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:20:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2157846c-3b62-4384-aa02-2118ccb64197 tempest-TestServerVolumeAttachmentScenario-168066397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a61a12f6-2389-4a20-a03b-0b2a058e27b2 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:18 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a61a12f6-2389-4a20-a03b-0b2a058e27b2 Jul 08 01:20:18 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:19 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-14d91018-ecdd-4de2-8837-a536891008b6 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.a4907ddc-9545-48a6-a24c-8c61da7be8e4 1G" returned: 0 in 1.194s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-14d91018-ecdd-4de2-8837-a536891008b6 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.a4907ddc-9545-48a6-a24c-8c61da7be8e4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:19 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.a4907ddc-9545-48a6-a24c-8c61da7be8e4 Jul 08 01:20:19 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:19 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2157846c-3b62-4384-aa02-2118ccb64197 tempest-TestServerVolumeAttachmentScenario-168066397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a61a12f6-2389-4a20-a03b-0b2a058e27b2" returned: 0 in 1.265s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2157846c-3b62-4384-aa02-2118ccb64197 tempest-TestServerVolumeAttachmentScenario-168066397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a61a12f6-2389-4a20-a03b-0b2a058e27b2 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:20 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a61a12f6-2389-4a20-a03b-0b2a058e27b2 Jul 08 01:20:20 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:20 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-14d91018-ecdd-4de2-8837-a536891008b6 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.a4907ddc-9545-48a6-a24c-8c61da7be8e4" returned: 0 in 1.052s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:20 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-14d91018-ecdd-4de2-8837-a536891008b6 tempest-VolumesSnapshotTestJSON-1641979681 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.a4907ddc-9545-48a6-a24c-8c61da7be8e4 is being set with open permissions: ugo+rw Jul 08 01:20:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-14d91018-ecdd-4de2-8837-a536891008b6 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.a4907ddc-9545-48a6-a24c-8c61da7be8e4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:20 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.a4907ddc-9545-48a6-a24c-8c61da7be8e4 Jul 08 01:20:20 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:20 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2157846c-3b62-4384-aa02-2118ccb64197 tempest-TestServerVolumeAttachmentScenario-168066397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a61a12f6-2389-4a20-a03b-0b2a058e27b2" returned: 0 in 0.793s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2157846c-3b62-4384-aa02-2118ccb64197 tempest-TestServerVolumeAttachmentScenario-168066397 None] Lock "cinder-quobyte-a61a12f6-2389-4a20-a03b-0b2a058e27b2" released by "delete_volume" :: held 2.130s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:20:20 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-14d91018-ecdd-4de2-8837-a536891008b6 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.a4907ddc-9545-48a6-a24c-8c61da7be8e4" returned: 0 in 0.768s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:20 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-2157846c-3b62-4384-aa02-2118ccb64197 tempest-TestServerVolumeAttachmentScenario-168066397 None] Created reservations ['fe9c218f-29c4-40a1-a27a-38023c72e454', 'd675dd38-2f0f-4452-af9a-2a5bd66c19a4', 'bedca445-744b-44ca-99c9-dfe07faef75f', '5fe81e3d-19ef-4be9-91b2-085e85661b4c'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:20:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-14d91018-ecdd-4de2-8837-a536891008b6 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:20 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.info Jul 08 01:20:20 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2157846c-3b62-4384-aa02-2118ccb64197 tempest-TestServerVolumeAttachmentScenario-168066397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2157846c-3b62-4384-aa02-2118ccb64197 tempest-TestServerVolumeAttachmentScenario-168066397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-2157846c-3b62-4384-aa02-2118ccb64197 tempest-TestServerVolumeAttachmentScenario-168066397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-2157846c-3b62-4384-aa02-2118ccb64197 tempest-TestServerVolumeAttachmentScenario-168066397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2157846c-3b62-4384-aa02-2118ccb64197 tempest-TestServerVolumeAttachmentScenario-168066397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2157846c-3b62-4384-aa02-2118ccb64197 tempest-TestServerVolumeAttachmentScenario-168066397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:21 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:20:21 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Flow 'volume_create_manager' (c3768171-fe7e-4722-b59b-331b9787c00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (168ca81b-3873-4bdc-abbf-483b445bb400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (168ca81b-3873-4bdc-abbf-483b445bb400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1825630733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83eb3da9-9422-45cb-9620-8baed7a85580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c1bb8c184664327822987db90abd5f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:20:21Z,use_quota=True,user_id='50c59187c5224463868d0d6e9543a801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56897043-f73e-4dca-8c82-a0ba001b43af),volume_type_id=56897043-f73e-4dca-8c82-a0ba001b43af)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e0dacc-1c20-4291-9e5d-689117699ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e0dacc-1c20-4291-9e5d-689117699ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada7659d-c25e-4257-9448-51b2e3ed0344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada7659d-c25e-4257-9448-51b2e3ed0344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83eb3da9-9422-45cb-9620-8baed7a85580', 'volume_name': 'volume-83eb3da9-9422-45cb-9620-8baed7a85580', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902fedf3-6a3d-4af0-b271-a952ff1bdc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902fedf3-6a3d-4af0-b271-a952ff1bdc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686c85cc-282c-4e4d-a815-fe7ab6550ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:21 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Volume 83eb3da9-9422-45cb-9620-8baed7a85580: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83eb3da9-9422-45cb-9620-8baed7a85580', 'volume_size': 1} Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Flow 'volume_create_manager' (af903adf-d1db-42ac-a6e8-0d775c7ca607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (771d87ff-ab9e-4935-8c58-eb3e6d263b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (771d87ff-ab9e-4935-8c58-eb3e6d263b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2016918851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83805664-bb82-4422-bbb0-413edd8964ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c1bb8c184664327822987db90abd5f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:20:22Z,use_quota=True,user_id='50c59187c5224463868d0d6e9543a801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf753e88-9341-4e4e-85d8-93659a2f85f2),volume_type_id=cf753e88-9341-4e4e-85d8-93659a2f85f2)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b89fe003-5116-419a-b86b-ad34e2df8cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b89fe003-5116-419a-b86b-ad34e2df8cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a4b7d7-c6cb-46f2-843e-241662e92bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a4b7d7-c6cb-46f2-843e-241662e92bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83805664-bb82-4422-bbb0-413edd8964ca', 'volume_name': 'volume-83805664-bb82-4422-bbb0-413edd8964ca', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799c411d-9e7c-4f8f-a67b-3999bb13bdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799c411d-9e7c-4f8f-a67b-3999bb13bdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f01869f6-b4c1-4a16-8cef-17aabb00c3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:21 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Volume 83805664-bb82-4422-bbb0-413edd8964ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83805664-bb82-4422-bbb0-413edd8964ca', 'volume_size': 1} Jul 08 01:20:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:20:22 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-14d91018-ecdd-4de2-8837-a536891008b6 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.info" returned: 0 in 1.125s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:22 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-14d91018-ecdd-4de2-8837-a536891008b6 tempest-VolumesSnapshotTestJSON-1641979681 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.info is being set with open permissions: ugo+rw Jul 08 01:20:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-14d91018-ecdd-4de2-8837-a536891008b6 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:22 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.info Jul 08 01:20:22 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e2207f68-9418-453a-97d7-12e5ae63bc64 tempest-TestServerVolumeAttachmentScenario-168066397 None] Acquiring lock "cinder-47051ab9-b825-4531-a212-2fcb7e5f26af-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:20:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e2207f68-9418-453a-97d7-12e5ae63bc64 tempest-TestServerVolumeAttachmentScenario-168066397 None] Lock "cinder-47051ab9-b825-4531-a212-2fcb7e5f26af-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:20:22 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2157846c-3b62-4384-aa02-2118ccb64197 tempest-TestServerVolumeAttachmentScenario-168066397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.160s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:22 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-2157846c-3b62-4384-aa02-2118ccb64197 tempest-TestServerVolumeAttachmentScenario-168066397 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:20:22 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-2157846c-3b62-4384-aa02-2118ccb64197 tempest-TestServerVolumeAttachmentScenario-168066397 None] Deleted volume successfully. Jul 08 01:20:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e2207f68-9418-453a-97d7-12e5ae63bc64 tempest-TestServerVolumeAttachmentScenario-168066397 None] Acquiring lock "cinder-quobyte-47051ab9-b825-4531-a212-2fcb7e5f26af" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:20:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2157846c-3b62-4384-aa02-2118ccb64197 tempest-TestServerVolumeAttachmentScenario-168066397 None] Lock "cinder-a61a12f6-2389-4a20-a03b-0b2a058e27b2-delete_volume" released by "delete_volume" :: held 3.706s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:20:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e2207f68-9418-453a-97d7-12e5ae63bc64 tempest-TestServerVolumeAttachmentScenario-168066397 None] Lock "cinder-quobyte-47051ab9-b825-4531-a212-2fcb7e5f26af" acquired by "delete_volume" :: waited 0.035s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:20:22 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4efce2-90ee-4326-81b7-53b609e3e266]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:20:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e2207f68-9418-453a-97d7-12e5ae63bc64 tempest-TestServerVolumeAttachmentScenario-168066397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-47051ab9-b825-4531-a212-2fcb7e5f26af {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:22 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-47051ab9-b825-4531-a212-2fcb7e5f26af Jul 08 01:20:22 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:22 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:20:22 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Flow 'volume_create_manager' (5d8f59b1-38f9-411f-86c0-f1df04f39b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:20:22 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4884f624-f941-49d2-8085-d7994a7ebf48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:23 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4884f624-f941-49d2-8085-d7994a7ebf48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-502940998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb620007-70a3-48d1-8e72-b0272e04f0a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c1bb8c184664327822987db90abd5f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:20:23Z,use_quota=True,user_id='50c59187c5224463868d0d6e9543a801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20c8f034-e040-453c-9b83-b08be310b306),volume_type_id=20c8f034-e040-453c-9b83-b08be310b306)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db673593-7d79-4bdc-89eb-9395158ab82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db673593-7d79-4bdc-89eb-9395158ab82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c88955b6-fbbc-4248-8639-28836822d85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:23 devstack cinder-volume[87022]: DEBUG cinder.image.glance [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Creating Keystone auth plugin from conf {{(pid=87022) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:20:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-14d91018-ecdd-4de2-8837-a536891008b6 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.info" returned: 0 in 1.064s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-14d91018-ecdd-4de2-8837-a536891008b6 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.398s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:20:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.627s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:20:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1825630733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83eb3da9-9422-45cb-9620-8baed7a85580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c1bb8c184664327822987db90abd5f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:20:21Z,use_quota=True,user_id='50c59187c5224463868d0d6e9543a801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56897043-f73e-4dca-8c82-a0ba001b43af),volume_type_id=56897043-f73e-4dca-8c82-a0ba001b43af)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:20:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Creating volume 83eb3da9-9422-45cb-9620-8baed7a85580 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:20:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:20:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:20:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:20:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:20:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:20:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:20:23 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:20:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83eb3da9-9422-45cb-9620-8baed7a85580 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:23 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83eb3da9-9422-45cb-9620-8baed7a85580 1073741824 Jul 08 01:20:23 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:23 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-14d91018-ecdd-4de2-8837-a536891008b6 tempest-VolumesSnapshotTestJSON-1641979681 None] Create snapshot completed successfully Jul 08 01:20:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c88955b6-fbbc-4248-8639-28836822d85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'eb620007-70a3-48d1-8e72-b0272e04f0a3', 'volume_name': 'volume-eb620007-70a3-48d1-8e72-b0272e04f0a3', 'volume_size': 1, 'image_id': 'ca035c4f-8a8f-4076-bf4a-378473e8c41c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca035c4f-8a8f-4076-bf4a-378473e8c41c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1167729025', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c1bb8c184664327822987db90abd5f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ca035c4f-8a8f-4076-bf4a-378473e8c41c', 'created_at': datetime.datetime(2026, 7, 7, 23, 20, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 20, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca035c4f-8a8f-4076-bf4a-378473e8c41c/file', 'properties': {}}, 'image_service': }' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e1b48bf-d017-47d7-b429-e1c91b35b439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e1b48bf-d017-47d7-b429-e1c91b35b439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe6b1f4-8c14-42ae-9baa-a825128e9551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:23 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Volume eb620007-70a3-48d1-8e72-b0272e04f0a3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-eb620007-70a3-48d1-8e72-b0272e04f0a3', 'volume_size': 1, 'image_id': 'ca035c4f-8a8f-4076-bf4a-378473e8c41c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca035c4f-8a8f-4076-bf4a-378473e8c41c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1167729025', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c1bb8c184664327822987db90abd5f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ca035c4f-8a8f-4076-bf4a-378473e8c41c', 'created_at': datetime.datetime(2026, 7, 7, 23, 20, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 20, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca035c4f-8a8f-4076-bf4a-378473e8c41c/file', 'properties': {}}, 'image_service': } Jul 08 01:20:23 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Trying to clone eb620007-70a3-48d1-8e72-b0272e04f0a3 from image ca035c4f-8a8f-4076-bf4a-378473e8c41c at location (None, [{'url': 'file:///opt/stack/data/glance/images/ca035c4f-8a8f-4076-bf4a-378473e8c41c', 'metadata': {}}]). {{(pid=87022) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:20:23 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e2207f68-9418-453a-97d7-12e5ae63bc64 tempest-TestServerVolumeAttachmentScenario-168066397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-47051ab9-b825-4531-a212-2fcb7e5f26af" returned: 0 in 1.262s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e2207f68-9418-453a-97d7-12e5ae63bc64 tempest-TestServerVolumeAttachmentScenario-168066397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-47051ab9-b825-4531-a212-2fcb7e5f26af {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:23 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-47051ab9-b825-4531-a212-2fcb7e5f26af Jul 08 01:20:23 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:24 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83eb3da9-9422-45cb-9620-8baed7a85580 1073741824" returned: 0 in 1.206s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:24 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=69,cinder:UPDATE=61,cinder:DELETE=5,cinder:INSERT=17 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:20:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83eb3da9-9422-45cb-9620-8baed7a85580 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:24 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83eb3da9-9422-45cb-9620-8baed7a85580 Jul 08 01:20:24 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:24 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e2207f68-9418-453a-97d7-12e5ae63bc64 tempest-TestServerVolumeAttachmentScenario-168066397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-47051ab9-b825-4531-a212-2fcb7e5f26af" returned: 0 in 1.063s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e2207f68-9418-453a-97d7-12e5ae63bc64 tempest-TestServerVolumeAttachmentScenario-168066397 None] Lock "cinder-quobyte-47051ab9-b825-4531-a212-2fcb7e5f26af" released by "delete_volume" :: held 2.398s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:20:24 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-e2207f68-9418-453a-97d7-12e5ae63bc64 tempest-TestServerVolumeAttachmentScenario-168066397 None] Created reservations ['1c7ff399-fe30-4526-af91-e141c99a65ec', '0b159370-b0d1-4b48-9a92-f5e5850539a6', '6da41a5d-b2c5-4af2-8d6f-4803d2d14de8', '124fcf95-b63b-490f-95a4-945b67ea2d15'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e2207f68-9418-453a-97d7-12e5ae63bc64 tempest-TestServerVolumeAttachmentScenario-168066397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e2207f68-9418-453a-97d7-12e5ae63bc64 tempest-TestServerVolumeAttachmentScenario-168066397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e2207f68-9418-453a-97d7-12e5ae63bc64 tempest-TestServerVolumeAttachmentScenario-168066397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e2207f68-9418-453a-97d7-12e5ae63bc64 tempest-TestServerVolumeAttachmentScenario-168066397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e2207f68-9418-453a-97d7-12e5ae63bc64 tempest-TestServerVolumeAttachmentScenario-168066397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e2207f68-9418-453a-97d7-12e5ae63bc64 tempest-TestServerVolumeAttachmentScenario-168066397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:25 devstack sudo[99760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:20:25 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Flow 'volume_create_manager' (63033e7a-18a7-4818-a8a3-413ee8c01ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2726e998-7ef6-43e4-9b14-12dbbc0cc0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2726e998-7ef6-43e4-9b14-12dbbc0cc0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-142409931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72490312-c62d-4d5e-9e4a-6758b4acf5c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b58dc8aa4847f2a6b2736b96ac6c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:20:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=a4907ddc-9545-48a6-a24c-8c61da7be8e4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:20:25Z,use_quota=True,user_id='e8bebc9f0edd4842b7f8c8e87e0e0beb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72928706-93c6-4621-bba8-5097163a2ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72928706-93c6-4621-bba8-5097163a2ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac049266-386c-446e-a248-63ea43745e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac049266-386c-446e-a248-63ea43745e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '72490312-c62d-4d5e-9e4a-6758b4acf5c7', 'volume_name': 'volume-72490312-c62d-4d5e-9e4a-6758b4acf5c7', 'volume_size': 2, 'snapshot_id': 'a4907ddc-9545-48a6-a24c-8c61da7be8e4'}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820b7f15-5047-490b-a787-9bf29b6677c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820b7f15-5047-490b-a787-9bf29b6677c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c785bef9-fbe3-4b27-aacb-8ab59323db34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:25 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Volume 72490312-c62d-4d5e-9e4a-6758b4acf5c7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-72490312-c62d-4d5e-9e4a-6758b4acf5c7', 'volume_size': 2, 'snapshot_id': 'a4907ddc-9545-48a6-a24c-8c61da7be8e4'} Jul 08 01:20:25 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83eb3da9-9422-45cb-9620-8baed7a85580" returned: 0 in 1.168s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] <== create_volume: return (2451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.457s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.615s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2016918851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83805664-bb82-4422-bbb0-413edd8964ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c1bb8c184664327822987db90abd5f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:20:22Z,use_quota=True,user_id='50c59187c5224463868d0d6e9543a801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf753e88-9341-4e4e-85d8-93659a2f85f2),volume_type_id=cf753e88-9341-4e4e-85d8-93659a2f85f2)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Creating volume 83805664-bb82-4422-bbb0-413edd8964ca {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:20:25 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83805664-bb82-4422-bbb0-413edd8964ca 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:20:25 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83805664-bb82-4422-bbb0-413edd8964ca 1073741824 Jul 08 01:20:25 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686c85cc-282c-4e4d-a815-fe7ab6550ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83eb3da9-9422-45cb-9620-8baed7a85580', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b44f2ff-c823-499d-872a-51829304ccda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:25 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Volume volume-83eb3da9-9422-45cb-9620-8baed7a85580 (83eb3da9-9422-45cb-9620-8baed7a85580): created successfully Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b44f2ff-c823-499d-872a-51829304ccda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Flow 'volume_create_manager' (c3768171-fe7e-4722-b59b-331b9787c00a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:20:25 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-aea8bc22-c7c4-426f-b889-827f42ec2b7c tempest-TestInstancesWithCinderVolumes-269993021 None] Created volume successfully. Jul 08 01:20:26 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e2207f68-9418-453a-97d7-12e5ae63bc64 tempest-TestServerVolumeAttachmentScenario-168066397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.153s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:26 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-e2207f68-9418-453a-97d7-12e5ae63bc64 tempest-TestServerVolumeAttachmentScenario-168066397 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:20:26 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-e2207f68-9418-453a-97d7-12e5ae63bc64 tempest-TestServerVolumeAttachmentScenario-168066397 None] Deleted volume successfully. Jul 08 01:20:26 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e2207f68-9418-453a-97d7-12e5ae63bc64 tempest-TestServerVolumeAttachmentScenario-168066397 None] Lock "cinder-47051ab9-b825-4531-a212-2fcb7e5f26af-delete_volume" released by "delete_volume" :: held 4.038s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:20:26 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83805664-bb82-4422-bbb0-413edd8964ca 1073741824" returned: 0 in 1.376s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83805664-bb82-4422-bbb0-413edd8964ca {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:27 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83805664-bb82-4422-bbb0-413edd8964ca Jul 08 01:20:27 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:27 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83805664-bb82-4422-bbb0-413edd8964ca" returned: 0 in 0.794s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] <== create_volume: return (2241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:20:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.244s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:20:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.222s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:20:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "cinder-quobyte-a4907ddc-9545-48a6-a24c-8c61da7be8e4-72490312-c62d-4d5e-9e4a-6758b4acf5c7" by "_create_volume_from_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:20:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f01869f6-b4c1-4a16-8cef-17aabb00c3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83805664-bb82-4422-bbb0-413edd8964ca', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ffd76e-d7cc-4618-9c9a-34f3b906c000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-a4907ddc-9545-48a6-a24c-8c61da7be8e4-72490312-c62d-4d5e-9e4a-6758b4acf5c7" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:20:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Creating volume 72490312-c62d-4d5e-9e4a-6758b4acf5c7 from snapshot a4907ddc-9545-48a6-a24c-8c61da7be8e4 {{(pid=87022) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:20:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:20:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:20:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:20:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:20:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:20:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:20:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "cinder-quobyte-72490312-c62d-4d5e-9e4a-6758b4acf5c7" by "_copy_volume_from_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:20:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-72490312-c62d-4d5e-9e4a-6758b4acf5c7" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:20:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] snapshot: a4907ddc-9545-48a6-a24c-8c61da7be8e4, volume: 72490312-c62d-4d5e-9e4a-6758b4acf5c7, {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:20:27 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Volume volume-83805664-bb82-4422-bbb0-413edd8964ca (83805664-bb82-4422-bbb0-413edd8964ca): created successfully Jul 08 01:20:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ffd76e-d7cc-4618-9c9a-34f3b906c000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Flow 'volume_create_manager' (af903adf-d1db-42ac-a6e8-0d775c7ca607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:20:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:20:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:20:28 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:20:28 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:20:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:20:28 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-bf7ab93c-95b9-4894-8175-6188e482984b tempest-TestInstancesWithCinderVolumes-269993021 None] Created volume successfully. Jul 08 01:20:28 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1ee4fb-900e-4b69-af90-b6c4637fc58e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:20:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.a4907ddc-9545-48a6-a24c-8c61da7be8e4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:28 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.a4907ddc-9545-48a6-a24c-8c61da7be8e4 Jul 08 01:20:28 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:29 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ca035c4f-8a8f-4076-bf4a-378473e8c41c_gikvi4qddevstack@QuobyteHD, size 20.69 MB, duration 5.46 sec {{(pid=87022) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:20:29 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Image download 20.69 MB at 3.79 MB/s Jul 08 01:20:29 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d7ddd8-6cd1-469b-aa79-bce457165499]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:20:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca035c4f-8a8f-4076-bf4a-378473e8c41c_gikvi4qddevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:29 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca035c4f-8a8f-4076-bf4a-378473e8c41c_gikvi4qddevstack@QuobyteHD Jul 08 01:20:29 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:29 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.a4907ddc-9545-48a6-a24c-8c61da7be8e4" returned: 0 in 1.290s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:20:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] will copy from snapshot at /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4 {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:20:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Creating direct copy from snapshot {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:20:29 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc781d25-d7c7-4def-a0c3-d1f83a1aec7e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:20:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:29 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4 Jul 08 01:20:29 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:30 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca035c4f-8a8f-4076-bf4a-378473e8c41c_gikvi4qddevstack@QuobyteHD" returned: 0 in 0.959s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:30 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Temporary image ca035c4f-8a8f-4076-bf4a-378473e8c41c is fetched for user 50c59187c5224463868d0d6e9543a801. {{(pid=87022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:20:30 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f76c3c8-9bc2-4d6b-aac0-cde193b6aca0]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:20:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca035c4f-8a8f-4076-bf4a-378473e8c41c_gikvi4qddevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:30 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca035c4f-8a8f-4076-bf4a-378473e8c41c_gikvi4qddevstack@QuobyteHD Jul 08 01:20:30 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:30 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4" returned: 0 in 1.049s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:30 devstack cinder-volume[87022]: DEBUG cinder.utils [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Path /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-72490312-c62d-4d5e-9e4a-6758b4acf5c7 not found in is_blk_device check {{(pid=87022) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:20:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-72490312-c62d-4d5e-9e4a-6758b4acf5c7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:30 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-72490312-c62d-4d5e-9e4a-6758b4acf5c7 Jul 08 01:20:30 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:31 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca035c4f-8a8f-4076-bf4a-378473e8c41c_gikvi4qddevstack@QuobyteHD" returned: 0 in 0.954s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:20:36 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-72490312-c62d-4d5e-9e4a-6758b4acf5c7" returned: 0 in 6.241s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:36 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[788d6b3a-1a72-4241-a6a8-319d78a4487d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:20:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:36 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4 Jul 08 01:20:36 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:37 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4" returned: 0 in 1.109s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:37 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Image conversion details: src /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4, size 1024.00 MB, duration 6.24 sec, destination /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-72490312-c62d-4d5e-9e4a-6758b4acf5c7 {{(pid=87022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:20:37 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Converted 1024.00 MB image at 164.05 MB/s Jul 08 01:20:37 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-72490312-c62d-4d5e-9e4a-6758b4acf5c7 is being set with open permissions: ugo+rw Jul 08 01:20:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-72490312-c62d-4d5e-9e4a-6758b4acf5c7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:37 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-72490312-c62d-4d5e-9e4a-6758b4acf5c7 Jul 08 01:20:37 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:38 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-72490312-c62d-4d5e-9e4a-6758b4acf5c7" returned: 0 in 0.788s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:38 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-72490312-c62d-4d5e-9e4a-6758b4acf5c7" released by "_copy_volume_from_snapshot" :: held 10.637s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:20:38 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-a4907ddc-9545-48a6-a24c-8c61da7be8e4-72490312-c62d-4d5e-9e4a-6758b4acf5c7" released by "_create_volume_from_snapshot" :: held 10.675s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:20:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.715s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:20:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.453s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:20:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-502940998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb620007-70a3-48d1-8e72-b0272e04f0a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c1bb8c184664327822987db90abd5f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:20:23Z,use_quota=True,user_id='50c59187c5224463868d0d6e9543a801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20c8f034-e040-453c-9b83-b08be310b306),volume_type_id=20c8f034-e040-453c-9b83-b08be310b306)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:20:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Creating volume eb620007-70a3-48d1-8e72-b0272e04f0a3 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:20:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:20:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:20:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:20:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:20:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:20:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:20:38 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:20:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:38 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3 1073741824 Jul 08 01:20:38 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c785bef9-fbe3-4b27-aacb-8ab59323db34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72490312-c62d-4d5e-9e4a-6758b4acf5c7', 'volume_size': 2, 'snapshot_id': 'a4907ddc-9545-48a6-a24c-8c61da7be8e4'}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f6e65d-873b-49b2-aa35-ca881be5bb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:38 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Volume volume-72490312-c62d-4d5e-9e4a-6758b4acf5c7 (72490312-c62d-4d5e-9e4a-6758b4acf5c7): created successfully Jul 08 01:20:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f6e65d-873b-49b2-aa35-ca881be5bb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Flow 'volume_create_manager' (63033e7a-18a7-4818-a8a3-413ee8c01ab3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:20:38 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-b12fc3ff-b012-49c7-83b9-876fee6fab08 tempest-VolumesSnapshotTestJSON-1641979681 None] Created volume successfully. Jul 08 01:20:38 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-689c7827-f678-42bb-a88c-0a899897b885 tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "cinder-72490312-c62d-4d5e-9e4a-6758b4acf5c7-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:20:39 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-689c7827-f678-42bb-a88c-0a899897b885 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-72490312-c62d-4d5e-9e4a-6758b4acf5c7-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:20:39 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-689c7827-f678-42bb-a88c-0a899897b885 tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "cinder-quobyte-72490312-c62d-4d5e-9e4a-6758b4acf5c7" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:20:39 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-689c7827-f678-42bb-a88c-0a899897b885 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-72490312-c62d-4d5e-9e4a-6758b4acf5c7" acquired by "delete_volume" :: waited 0.023s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:20:39 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb96b55-e300-4c31-a329-a48f8e8d4f70]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:20:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-689c7827-f678-42bb-a88c-0a899897b885 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-72490312-c62d-4d5e-9e4a-6758b4acf5c7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:39 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-72490312-c62d-4d5e-9e4a-6758b4acf5c7 Jul 08 01:20:39 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:39 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3 1073741824" returned: 0 in 1.118s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:39 devstack sudo[99853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3 Jul 08 01:20:39 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:40 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-689c7827-f678-42bb-a88c-0a899897b885 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-72490312-c62d-4d5e-9e4a-6758b4acf5c7" returned: 0 in 0.921s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-689c7827-f678-42bb-a88c-0a899897b885 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-72490312-c62d-4d5e-9e4a-6758b4acf5c7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:40 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-72490312-c62d-4d5e-9e4a-6758b4acf5c7 Jul 08 01:20:40 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:40 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3" returned: 0 in 0.936s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:40 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] <== create_volume: return (2121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:20:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.124s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:20:40 devstack cinder-volume[87022]: DEBUG cinder.volume.volume_utils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Attempting download of ca035c4f-8a8f-4076-bf4a-378473e8c41c ((None, [{'url': 'file:///opt/stack/data/glance/images/ca035c4f-8a8f-4076-bf4a-378473e8c41c', 'metadata': {}}])) to volume eb620007-70a3-48d1-8e72-b0272e04f0a3. {{(pid=87022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:20:40 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[6492d231-cbfb-44dd-9508-651610bbed38]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:20:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca035c4f-8a8f-4076-bf4a-378473e8c41c_mrj0lgh_ {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:40 devstack sudo[99861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca035c4f-8a8f-4076-bf4a-378473e8c41c_mrj0lgh_ Jul 08 01:20:40 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:40 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-689c7827-f678-42bb-a88c-0a899897b885 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-72490312-c62d-4d5e-9e4a-6758b4acf5c7" returned: 0 in 0.882s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:40 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-689c7827-f678-42bb-a88c-0a899897b885 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-72490312-c62d-4d5e-9e4a-6758b4acf5c7" released by "delete_volume" :: held 1.857s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:20:41 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-689c7827-f678-42bb-a88c-0a899897b885 tempest-VolumesSnapshotTestJSON-1641979681 None] Created reservations ['face1c17-740a-4316-a49b-454bd7f51706', '00b0bfe3-0c43-44b1-aeca-4920b7714000', '03b4a81c-08c9-4b98-a311-c78b8f980824', 'a85491c2-9bfa-4552-93d3-40d0999823b1'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:20:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-689c7827-f678-42bb-a88c-0a899897b885 tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:20:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-689c7827-f678-42bb-a88c-0a899897b885 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:20:41 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-689c7827-f678-42bb-a88c-0a899897b885 tempest-VolumesSnapshotTestJSON-1641979681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:20:41 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-689c7827-f678-42bb-a88c-0a899897b885 tempest-VolumesSnapshotTestJSON-1641979681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:20:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-689c7827-f678-42bb-a88c-0a899897b885 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:20:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-689c7827-f678-42bb-a88c-0a899897b885 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:41 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:20:41 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:41 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-fd0c62c6-fe4b-4c3f-8375-69721d2b5e26 tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "cinder-a4907ddc-9545-48a6-a24c-8c61da7be8e4-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:20:41 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-fd0c62c6-fe4b-4c3f-8375-69721d2b5e26 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-a4907ddc-9545-48a6-a24c-8c61da7be8e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:20:41 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-fd0c62c6-fe4b-4c3f-8375-69721d2b5e26 tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "cinder-quobyte-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:20:41 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-fd0c62c6-fe4b-4c3f-8375-69721d2b5e26 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:20:41 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-fd0c62c6-fe4b-4c3f-8375-69721d2b5e26 tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "cinder-quobyte-a4907ddc-9545-48a6-a24c-8c61da7be8e4" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:20:41 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-fd0c62c6-fe4b-4c3f-8375-69721d2b5e26 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-a4907ddc-9545-48a6-a24c-8c61da7be8e4" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:20:41 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-fd0c62c6-fe4b-4c3f-8375-69721d2b5e26 tempest-VolumesSnapshotTestJSON-1641979681 None] Deleting offline snapshot a4907ddc-9545-48a6-a24c-8c61da7be8e4 of volume b6ecd855-7ea3-46a7-a0f1-f40122e85ba4 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:20:41 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-fd0c62c6-fe4b-4c3f-8375-69721d2b5e26 tempest-VolumesSnapshotTestJSON-1641979681 None] snapshot_file for this snap is: volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.a4907ddc-9545-48a6-a24c-8c61da7be8e4 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:20:41 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d01145-5d39-46ab-9716-50d4c0e8bf56]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:20:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fd0c62c6-fe4b-4c3f-8375-69721d2b5e26 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.a4907ddc-9545-48a6-a24c-8c61da7be8e4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:42 devstack sudo[99899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.a4907ddc-9545-48a6-a24c-8c61da7be8e4 Jul 08 01:20:42 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:42 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:42 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-689c7827-f678-42bb-a88c-0a899897b885 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.935s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:42 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-689c7827-f678-42bb-a88c-0a899897b885 tempest-VolumesSnapshotTestJSON-1641979681 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:20:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca035c4f-8a8f-4076-bf4a-378473e8c41c_mrj0lgh_" returned: 0 in 1.487s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca035c4f-8a8f-4076-bf4a-378473e8c41c_mrj0lgh_ {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:42 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-689c7827-f678-42bb-a88c-0a899897b885 tempest-VolumesSnapshotTestJSON-1641979681 None] Deleted volume successfully. Jul 08 01:20:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-689c7827-f678-42bb-a88c-0a899897b885 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-72490312-c62d-4d5e-9e4a-6758b4acf5c7-delete_volume" released by "delete_volume" :: held 3.361s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:20:42 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca035c4f-8a8f-4076-bf4a-378473e8c41c_mrj0lgh_ Jul 08 01:20:42 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:43 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fd0c62c6-fe4b-4c3f-8375-69721d2b5e26 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.a4907ddc-9545-48a6-a24c-8c61da7be8e4" returned: 0 in 1.336s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:43 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-fd0c62c6-fe4b-4c3f-8375-69721d2b5e26 tempest-VolumesSnapshotTestJSON-1641979681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:20:43 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a43ab8c-2047-4c79-9358-320f0c20bd8d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:20:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fd0c62c6-fe4b-4c3f-8375-69721d2b5e26 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:43 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca035c4f-8a8f-4076-bf4a-378473e8c41c_mrj0lgh_" returned: 1 in 0.971s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca035c4f-8a8f-4076-bf4a-378473e8c41c_mrj0lgh_' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:20:43 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2929844-6b07-45cf-afff-d269e78ecc50]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:20:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca035c4f-8a8f-4076-bf4a-378473e8c41c_gikvi4qddevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:43 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4 Jul 08 01:20:43 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:43 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca035c4f-8a8f-4076-bf4a-378473e8c41c_gikvi4qddevstack@QuobyteHD Jul 08 01:20:43 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:44 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fd0c62c6-fe4b-4c3f-8375-69721d2b5e26 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4" returned: 0 in 1.075s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fd0c62c6-fe4b-4c3f-8375-69721d2b5e26 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.a4907ddc-9545-48a6-a24c-8c61da7be8e4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:44 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.a4907ddc-9545-48a6-a24c-8c61da7be8e4 Jul 08 01:20:44 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:44 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca035c4f-8a8f-4076-bf4a-378473e8c41c_gikvi4qddevstack@QuobyteHD" returned: 0 in 1.135s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:44 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] ca035c4f-8a8f-4076-bf4a-378473e8c41c was qcow2, converting to raw {{(pid=87022) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:20:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ca035c4f-8a8f-4076-bf4a-378473e8c41c_gikvi4qddevstack@QuobyteHD /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:44 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ca035c4f-8a8f-4076-bf4a-378473e8c41c_gikvi4qddevstack@QuobyteHD /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3 Jul 08 01:20:44 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:45 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:20:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:20:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:20:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:20:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:20:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:20:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:45 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fd0c62c6-fe4b-4c3f-8375-69721d2b5e26 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.a4907ddc-9545-48a6-a24c-8c61da7be8e4" returned: 0 in 1.190s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fd0c62c6-fe4b-4c3f-8375-69721d2b5e26 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.a4907ddc-9545-48a6-a24c-8c61da7be8e4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:45 devstack sudo[99971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:20:45 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:45 devstack sudo[99972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.a4907ddc-9545-48a6-a24c-8c61da7be8e4 Jul 08 01:20:45 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:46 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.270s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:46 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:20:46 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:20:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread count: 28 {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:20:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread info: [<_MainThread(MainThread, started 134382216167552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:20:47 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fd0c62c6-fe4b-4c3f-8375-69721d2b5e26 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4.a4907ddc-9545-48a6-a24c-8c61da7be8e4" returned: 0 in 1.576s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:47 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-fd0c62c6-fe4b-4c3f-8375-69721d2b5e26 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-a4907ddc-9545-48a6-a24c-8c61da7be8e4" released by "_delete_snapshot" :: held 5.396s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:20:47 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-fd0c62c6-fe4b-4c3f-8375-69721d2b5e26 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4" released by "delete_snapshot" :: held 5.465s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:20:47 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-fd0c62c6-fe4b-4c3f-8375-69721d2b5e26 tempest-VolumesSnapshotTestJSON-1641979681 None] Created reservations ['82d268f3-1d64-43cd-a730-766befa011c1', '9750f5b4-c6eb-461a-bcdc-176bf9fa96a6', 'e7affccb-3e66-44cb-995b-52fe4936aed5', 'b7408bb2-4aea-482b-a116-c59fbf8ee045'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:20:47 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-fd0c62c6-fe4b-4c3f-8375-69721d2b5e26 tempest-VolumesSnapshotTestJSON-1641979681 None] Delete snapshot completed successfully. Jul 08 01:20:47 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-fd0c62c6-fe4b-4c3f-8375-69721d2b5e26 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-a4907ddc-9545-48a6-a24c-8c61da7be8e4-delete_snapshot" released by "delete_snapshot" :: held 5.739s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:20:47 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ca035c4f-8a8f-4076-bf4a-378473e8c41c_gikvi4qddevstack@QuobyteHD /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3" returned: 0 in 3.516s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:47 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ca035c4f-8a8f-4076-bf4a-378473e8c41c_gikvi4qddevstack@QuobyteHD, size 112.00 MB, duration 3.52 sec, destination /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3 {{(pid=87022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:20:47 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Converted 112.00 MB image at 31.83 MB/s Jul 08 01:20:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:47 devstack sudo[99980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3 1G Jul 08 01:20:47 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:48 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4b7dd6a6-72ed-4349-9a43-83227c5d6497 tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "cinder-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:20:48 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4b7dd6a6-72ed-4349-9a43-83227c5d6497 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:20:48 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4b7dd6a6-72ed-4349-9a43-83227c5d6497 tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "cinder-quobyte-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:20:48 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4b7dd6a6-72ed-4349-9a43-83227c5d6497 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4" acquired by "delete_volume" :: waited 0.025s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:20:48 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d39ca3a-ade8-446b-9cff-60257e0e7a60]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:20:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4b7dd6a6-72ed-4349-9a43-83227c5d6497 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:48 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4 Jul 08 01:20:48 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:49 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3 1G" returned: 0 in 1.285s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:49 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46109c3-c37c-456b-aca6-6b2eb256a202]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:20:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:49 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3 Jul 08 01:20:49 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:50 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4b7dd6a6-72ed-4349-9a43-83227c5d6497 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4" returned: 0 in 1.489s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4b7dd6a6-72ed-4349-9a43-83227c5d6497 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:50 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4 Jul 08 01:20:50 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:50 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3" returned: 0 in 1.467s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:50 devstack sudo[99999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3 Jul 08 01:20:50 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:51 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4b7dd6a6-72ed-4349-9a43-83227c5d6497 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4" returned: 0 in 1.272s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:51 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4b7dd6a6-72ed-4349-9a43-83227c5d6497 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4" released by "delete_volume" :: held 2.882s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:20:51 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-4b7dd6a6-72ed-4349-9a43-83227c5d6497 tempest-VolumesSnapshotTestJSON-1641979681 None] Created reservations ['03b7369e-013f-4700-b310-570b1f431618', '539b97d7-8cdf-4ed3-a28d-d87f3660cb99', '44df9709-b87c-42fa-9d1b-e5b4fec2e2ec', 'a4768e0d-4b57-4c25-9437-823cc54be8cb'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:20:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4b7dd6a6-72ed-4349-9a43-83227c5d6497 tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:20:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4b7dd6a6-72ed-4349-9a43-83227c5d6497 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:20:51 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4b7dd6a6-72ed-4349-9a43-83227c5d6497 tempest-VolumesSnapshotTestJSON-1641979681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:20:51 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4b7dd6a6-72ed-4349-9a43-83227c5d6497 tempest-VolumesSnapshotTestJSON-1641979681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:20:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4b7dd6a6-72ed-4349-9a43-83227c5d6497 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:20:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4b7dd6a6-72ed-4349-9a43-83227c5d6497 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:51 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:20:51 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:52 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3" returned: 1 in 1.285s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:20:52 devstack cinder-volume[87022]: DEBUG cinder.volume.volume_utils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Downloaded image ca035c4f-8a8f-4076-bf4a-378473e8c41c ((None, [{'url': 'file:///opt/stack/data/glance/images/ca035c4f-8a8f-4076-bf4a-378473e8c41c', 'metadata': {}}])) to volume eb620007-70a3-48d1-8e72-b0272e04f0a3 successfully. {{(pid=87022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:20:52 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Temporary image ca035c4f-8a8f-4076-bf4a-378473e8c41c for user 50c59187c5224463868d0d6e9543a801 is deleted. {{(pid=87022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:20:52 devstack cinder-volume[87022]: DEBUG cinder.volume.volume_utils [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Marking volume eb620007-70a3-48d1-8e72-b0272e04f0a3 as bootable. {{(pid=87022) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:20:52 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Copying metadata from image ca035c4f-8a8f-4076-bf4a-378473e8c41c to eb620007-70a3-48d1-8e72-b0272e04f0a3. {{(pid=87022) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:20:52 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Creating volume glance metadata for volume eb620007-70a3-48d1-8e72-b0272e04f0a3 backed by image ca035c4f-8a8f-4076-bf4a-378473e8c41c with: {'image_id': 'ca035c4f-8a8f-4076-bf4a-378473e8c41c', 'image_name': 'tempest-scenario-img--1167729025', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87022) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:20:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe6b1f4-8c14-42ae-9baa-a825128e9551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb620007-70a3-48d1-8e72-b0272e04f0a3', 'volume_size': 1, 'image_id': 'ca035c4f-8a8f-4076-bf4a-378473e8c41c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca035c4f-8a8f-4076-bf4a-378473e8c41c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1167729025', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c1bb8c184664327822987db90abd5f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ca035c4f-8a8f-4076-bf4a-378473e8c41c', 'created_at': datetime.datetime(2026, 7, 7, 23, 20, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 20, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca035c4f-8a8f-4076-bf4a-378473e8c41c/file', 'properties': {}}, 'image_service': }' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443185b0-0929-4c1b-9349-08e17ecd005b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:52 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Volume volume-eb620007-70a3-48d1-8e72-b0272e04f0a3 (eb620007-70a3-48d1-8e72-b0272e04f0a3): created successfully Jul 08 01:20:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443185b0-0929-4c1b-9349-08e17ecd005b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Flow 'volume_create_manager' (5d8f59b1-38f9-411f-86c0-f1df04f39b96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:20:52 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-7a801aed-2eb5-4023-abb0-2c0cbc3cd97b tempest-TestInstancesWithCinderVolumes-269993021 None] Created volume successfully. Jul 08 01:20:52 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4b7dd6a6-72ed-4349-9a43-83227c5d6497 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.099s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:52 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-4b7dd6a6-72ed-4349-9a43-83227c5d6497 tempest-VolumesSnapshotTestJSON-1641979681 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:20:52 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-4b7dd6a6-72ed-4349-9a43-83227c5d6497 tempest-VolumesSnapshotTestJSON-1641979681 None] Deleted volume successfully. Jul 08 01:20:52 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4b7dd6a6-72ed-4349-9a43-83227c5d6497 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-b6ecd855-7ea3-46a7-a0f1-f40122e85ba4-delete_volume" released by "delete_volume" :: held 4.350s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:20:52 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:20:53 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Flow 'volume_create_manager' (1a0d15f6-bc48-40ca-b2d2-68fd51aaefb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:20:53 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be35c51-6500-4738-a51e-e38966c0a5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:53 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be35c51-6500-4738-a51e-e38966c0a5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-293892377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b06e074-4761-4678-9c3e-c2a8f88fe8e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b58dc8aa4847f2a6b2736b96ac6c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:20:53Z,use_quota=True,user_id='e8bebc9f0edd4842b7f8c8e87e0e0beb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:53 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdfddeea-cfec-432b-b7e3-418e55db9987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:53 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdfddeea-cfec-432b-b7e3-418e55db9987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:53 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde1cfe9-6b98-418a-bedb-bb1d99bb2cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:53 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde1cfe9-6b98-418a-bedb-bb1d99bb2cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b06e074-4761-4678-9c3e-c2a8f88fe8e7', 'volume_name': 'volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:53 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71e9b73-b732-42d0-9f6b-86db44ff516f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:53 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71e9b73-b732-42d0-9f6b-86db44ff516f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:53 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25939991-2cbc-4a6e-b9a7-75af65526279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:53 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Volume 7b06e074-4761-4678-9c3e-c2a8f88fe8e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7', 'volume_size': 1} Jul 08 01:20:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:20:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:20:53 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-293892377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b06e074-4761-4678-9c3e-c2a8f88fe8e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b58dc8aa4847f2a6b2736b96ac6c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:20:53Z,use_quota=True,user_id='e8bebc9f0edd4842b7f8c8e87e0e0beb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:20:53 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Creating volume 7b06e074-4761-4678-9c3e-c2a8f88fe8e7 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:20:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:20:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:20:53 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:20:53 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:20:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:20:53 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:20:53 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:20:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:53 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7 1073741824 Jul 08 01:20:53 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:54 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7 1073741824" returned: 0 in 1.286s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:54 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7 Jul 08 01:20:54 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:55 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7" returned: 0 in 1.093s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:55 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] <== create_volume: return (2472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:20:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.475s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:20:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25939991-2cbc-4a6e-b9a7-75af65526279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292ed105-957f-4a73-a6ee-238f5703e69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:55 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Volume volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7 (7b06e074-4761-4678-9c3e-c2a8f88fe8e7): created successfully Jul 08 01:20:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292ed105-957f-4a73-a6ee-238f5703e69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Flow 'volume_create_manager' (1a0d15f6-bc48-40ca-b2d2-68fd51aaefb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:20:55 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-25f36bb0-f101-49bd-914d-37a4e2a1d180 tempest-VolumesSnapshotTestJSON-1641979681 None] Created volume successfully. Jul 08 01:20:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b84ff4de-02c5-4453-83c2-331813c056e4 tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:20:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b84ff4de-02c5-4453-83c2-331813c056e4 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:20:56 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-b84ff4de-02c5-4453-83c2-331813c056e4 tempest-VolumesSnapshotTestJSON-1641979681 None] Creating offline snapshot 990edc27-9485-4114-9486-caef5cec8884 of volume 7b06e074-4761-4678-9c3e-c2a8f88fe8e7 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:20:56 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[72738b71-0068-436a-b3c4-ae71d208869f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:20:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b84ff4de-02c5-4453-83c2-331813c056e4 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:56 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7 Jul 08 01:20:56 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:57 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b84ff4de-02c5-4453-83c2-331813c056e4 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7" returned: 0 in 1.046s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b84ff4de-02c5-4453-83c2-331813c056e4 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.990edc27-9485-4114-9486-caef5cec8884 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:57 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.990edc27-9485-4114-9486-caef5cec8884 1G Jul 08 01:20:57 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:58 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b84ff4de-02c5-4453-83c2-331813c056e4 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.990edc27-9485-4114-9486-caef5cec8884 1G" returned: 0 in 0.923s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b84ff4de-02c5-4453-83c2-331813c056e4 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.990edc27-9485-4114-9486-caef5cec8884 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:58 devstack sudo[100055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.990edc27-9485-4114-9486-caef5cec8884 Jul 08 01:20:58 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:59 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b84ff4de-02c5-4453-83c2-331813c056e4 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.990edc27-9485-4114-9486-caef5cec8884" returned: 0 in 0.785s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:59 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-b84ff4de-02c5-4453-83c2-331813c056e4 tempest-VolumesSnapshotTestJSON-1641979681 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.990edc27-9485-4114-9486-caef5cec8884 is being set with open permissions: ugo+rw Jul 08 01:20:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b84ff4de-02c5-4453-83c2-331813c056e4 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.990edc27-9485-4114-9486-caef5cec8884 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:59 devstack sudo[100061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.990edc27-9485-4114-9486-caef5cec8884 Jul 08 01:20:59 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:00 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b84ff4de-02c5-4453-83c2-331813c056e4 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.990edc27-9485-4114-9486-caef5cec8884" returned: 0 in 0.907s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b84ff4de-02c5-4453-83c2-331813c056e4 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:00 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.info Jul 08 01:21:00 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:01 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b84ff4de-02c5-4453-83c2-331813c056e4 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.info" returned: 0 in 0.917s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:01 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-b84ff4de-02c5-4453-83c2-331813c056e4 tempest-VolumesSnapshotTestJSON-1641979681 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.info is being set with open permissions: ugo+rw Jul 08 01:21:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b84ff4de-02c5-4453-83c2-331813c056e4 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:01 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.info Jul 08 01:21:01 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-adb277af-3300-44b9-a84b-661be3e6a10b req-e61a34eb-306c-4562-b409-414f0e6f2d0a tempest-TestInstancesWithCinderVolumes-269993021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:02 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b84ff4de-02c5-4453-83c2-331813c056e4 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.info" returned: 0 in 0.851s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b84ff4de-02c5-4453-83c2-331813c056e4 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.556s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-adb277af-3300-44b9-a84b-661be3e6a10b req-e61a34eb-306c-4562-b409-414f0e6f2d0a tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.742s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:02 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-b84ff4de-02c5-4453-83c2-331813c056e4 tempest-VolumesSnapshotTestJSON-1641979681 None] Create snapshot completed successfully Jul 08 01:21:02 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[40390631-357f-4d04-9214-88ab67942cce]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-adb277af-3300-44b9-a84b-661be3e6a10b req-e61a34eb-306c-4562-b409-414f0e6f2d0a tempest-TestInstancesWithCinderVolumes-269993021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:02 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3 Jul 08 01:21:02 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:03 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-adb277af-3300-44b9-a84b-661be3e6a10b req-e61a34eb-306c-4562-b409-414f0e6f2d0a tempest-TestInstancesWithCinderVolumes-269993021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3" returned: 0 in 0.923s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-adb277af-3300-44b9-a84b-661be3e6a10b req-e61a34eb-306c-4562-b409-414f0e6f2d0a tempest-TestInstancesWithCinderVolumes-269993021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:03 devstack sudo[100083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3 Jul 08 01:21:03 devstack sudo[100083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:03 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:21:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Flow 'volume_create_manager' (12a1a2e7-1aef-4b81-8804-bc06347206a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:21:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9436b04b-d89d-4e5f-91d8-b7250cca3739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9436b04b-d89d-4e5f-91d8-b7250cca3739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1013644624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f904ded3-9dbf-4c64-8d2d-032b76152421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b58dc8aa4847f2a6b2736b96ac6c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=990edc27-9485-4114-9486-caef5cec8884,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:21:04Z,use_quota=True,user_id='e8bebc9f0edd4842b7f8c8e87e0e0beb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57cd5a28-ddae-4901-b412-cea223ff39a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57cd5a28-ddae-4901-b412-cea223ff39a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a3fb3d-b96a-4bbc-929b-f9a1328f0acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a3fb3d-b96a-4bbc-929b-f9a1328f0acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f904ded3-9dbf-4c64-8d2d-032b76152421', 'volume_name': 'volume-f904ded3-9dbf-4c64-8d2d-032b76152421', 'volume_size': 1, 'snapshot_id': '990edc27-9485-4114-9486-caef5cec8884'}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6306feb-151e-4393-9f5a-49e0f98db942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6306feb-151e-4393-9f5a-49e0f98db942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9502c469-af73-4cce-894d-507d61b1cc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:03 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Volume f904ded3-9dbf-4c64-8d2d-032b76152421: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f904ded3-9dbf-4c64-8d2d-032b76152421', 'volume_size': 1, 'snapshot_id': '990edc27-9485-4114-9486-caef5cec8884'} Jul 08 01:21:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:04 devstack sudo[100083]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-adb277af-3300-44b9-a84b-661be3e6a10b req-e61a34eb-306c-4562-b409-414f0e6f2d0a tempest-TestInstancesWithCinderVolumes-269993021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3" returned: 1 in 0.897s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-adb277af-3300-44b9-a84b-661be3e6a10b req-e61a34eb-306c-4562-b409-414f0e6f2d0a tempest-TestInstancesWithCinderVolumes-269993021 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:21:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-adb277af-3300-44b9-a84b-661be3e6a10b req-e61a34eb-306c-4562-b409-414f0e6f2d0a tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.875s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.243s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:04 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "cinder-quobyte-990edc27-9485-4114-9486-caef5cec8884-f904ded3-9dbf-4c64-8d2d-032b76152421" by "_create_volume_from_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:04 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-990edc27-9485-4114-9486-caef5cec8884-f904ded3-9dbf-4c64-8d2d-032b76152421" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Creating volume f904ded3-9dbf-4c64-8d2d-032b76152421 from snapshot 990edc27-9485-4114-9486-caef5cec8884 {{(pid=87022) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:21:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:21:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:21:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:21:04 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "cinder-quobyte-f904ded3-9dbf-4c64-8d2d-032b76152421" by "_copy_volume_from_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:04 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-f904ded3-9dbf-4c64-8d2d-032b76152421" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] snapshot: 990edc27-9485-4114-9486-caef5cec8884, volume: f904ded3-9dbf-4c64-8d2d-032b76152421, {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:21:04 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-adb277af-3300-44b9-a84b-661be3e6a10b req-e61a34eb-306c-4562-b409-414f0e6f2d0a tempest-TestInstancesWithCinderVolumes-269993021 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d', 'name': 'volume-eb620007-70a3-48d1-8e72-b0272e04f0a3', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20dcdf6f-cb1d-490d-ae14-df45b53ddad1', 'enforce_multipath': True} {{(pid=87022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:21:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:21:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:21:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:04 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=68,cinder:DELETE=6,cinder:INSERT=17,cinder:UPDATE=71 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:21:04 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba6fa9c-7648-48cb-b152-6eb09cc949e2]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.990edc27-9485-4114-9486-caef5cec8884 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:04 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-adb277af-3300-44b9-a84b-661be3e6a10b req-e61a34eb-306c-4562-b409-414f0e6f2d0a tempest-TestInstancesWithCinderVolumes-269993021 None] attachment_update completed successfully. Jul 08 01:21:04 devstack sudo[100088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.990edc27-9485-4114-9486-caef5cec8884 Jul 08 01:21:04 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:05 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.990edc27-9485-4114-9486-caef5cec8884" returned: 0 in 0.997s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:05 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:21:05 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] will copy from snapshot at /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7 {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:21:05 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Creating direct copy from snapshot {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:21:05 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eadde20-cdf4-41ca-aeb2-b66ccc69d8b9]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:05 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7 Jul 08 01:21:05 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:06 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7" returned: 0 in 0.934s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:06 devstack cinder-volume[87022]: DEBUG cinder.utils [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Path /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f904ded3-9dbf-4c64-8d2d-032b76152421 not found in is_blk_device check {{(pid=87022) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:21:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f904ded3-9dbf-4c64-8d2d-032b76152421 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:06 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f904ded3-9dbf-4c64-8d2d-032b76152421 Jul 08 01:21:06 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:14 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=47,cinder:INSERT=15,cinder:UPDATE=44,cinder:DELETE=5 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:21:14 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=1 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:21:14 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f904ded3-9dbf-4c64-8d2d-032b76152421" returned: 0 in 8.707s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:14 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a443458-47b1-4997-af73-46541418294d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:15 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7 Jul 08 01:21:15 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:16 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:21:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Flow 'volume_create_manager' (4edf3dff-2bf8-4b0b-9e86-8d55f8bcc4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:21:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c2869f-30f0-4bbd-b48d-6161d4e90a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c2869f-30f0-4bbd-b48d-6161d4e90a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-208297776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e4a5fb-d968-4272-aa58-fc83747fa7e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b375ccd285564b40bee79178ba9b7d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:21:16Z,use_quota=True,user_id='0528533195d94df99be20c240d820362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c4b052e-d285-4e8d-b2cb-a3305410795b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c4b052e-d285-4e8d-b2cb-a3305410795b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7edb9786-725f-4e63-ab10-084a82b7240d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7edb9786-725f-4e63-ab10-084a82b7240d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10e4a5fb-d968-4272-aa58-fc83747fa7e3', 'volume_name': 'volume-10e4a5fb-d968-4272-aa58-fc83747fa7e3', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (110c5ea7-9025-4510-acc4-b1ee0fc8c55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (110c5ea7-9025-4510-acc4-b1ee0fc8c55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a01b381-1bf6-416e-8e2f-3dba73897131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:16 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Volume 10e4a5fb-d968-4272-aa58-fc83747fa7e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10e4a5fb-d968-4272-aa58-fc83747fa7e3', 'volume_size': 1} Jul 08 01:21:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:16 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7" returned: 0 in 1.811s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:16 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Image conversion details: src /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7, size 1024.00 MB, duration 8.71 sec, destination /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f904ded3-9dbf-4c64-8d2d-032b76152421 {{(pid=87022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:21:16 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Converted 1024.00 MB image at 117.60 MB/s Jul 08 01:21:16 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f904ded3-9dbf-4c64-8d2d-032b76152421 is being set with open permissions: ugo+rw Jul 08 01:21:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f904ded3-9dbf-4c64-8d2d-032b76152421 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:16 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f904ded3-9dbf-4c64-8d2d-032b76152421 Jul 08 01:21:16 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:17 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f904ded3-9dbf-4c64-8d2d-032b76152421" returned: 0 in 1.116s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:17 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-f904ded3-9dbf-4c64-8d2d-032b76152421" released by "_copy_volume_from_snapshot" :: held 13.748s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:17 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-990edc27-9485-4114-9486-caef5cec8884-f904ded3-9dbf-4c64-8d2d-032b76152421" released by "_create_volume_from_snapshot" :: held 13.817s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.849s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.672s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-208297776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e4a5fb-d968-4272-aa58-fc83747fa7e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b375ccd285564b40bee79178ba9b7d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:21:16Z,use_quota=True,user_id='0528533195d94df99be20c240d820362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:21:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Creating volume 10e4a5fb-d968-4272-aa58-fc83747fa7e3 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:21:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:21:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:21:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:21:17 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:21:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-10e4a5fb-d968-4272-aa58-fc83747fa7e3 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:17 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-10e4a5fb-d968-4272-aa58-fc83747fa7e3 1073741824 Jul 08 01:21:17 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9502c469-af73-4cce-894d-507d61b1cc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f904ded3-9dbf-4c64-8d2d-032b76152421', 'volume_size': 1, 'snapshot_id': '990edc27-9485-4114-9486-caef5cec8884'}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb86eeb-de0f-4562-8742-8736d349f508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:18 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Volume volume-f904ded3-9dbf-4c64-8d2d-032b76152421 (f904ded3-9dbf-4c64-8d2d-032b76152421): created successfully Jul 08 01:21:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb86eeb-de0f-4562-8742-8736d349f508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Flow 'volume_create_manager' (12a1a2e7-1aef-4b81-8804-bc06347206a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:21:18 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-c2ac4cec-0f34-4035-aac0-879d13312e8d tempest-VolumesSnapshotTestJSON-1641979681 None] Created volume successfully. Jul 08 01:21:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bba3a3b0-e78a-4e44-9f0f-dcc2a2abfd5d tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "cinder-f904ded3-9dbf-4c64-8d2d-032b76152421-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bba3a3b0-e78a-4e44-9f0f-dcc2a2abfd5d tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-f904ded3-9dbf-4c64-8d2d-032b76152421-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bba3a3b0-e78a-4e44-9f0f-dcc2a2abfd5d tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "cinder-quobyte-f904ded3-9dbf-4c64-8d2d-032b76152421" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bba3a3b0-e78a-4e44-9f0f-dcc2a2abfd5d tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-f904ded3-9dbf-4c64-8d2d-032b76152421" acquired by "delete_volume" :: waited 0.028s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:19 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[68745d76-6202-44c7-9b4c-77422ab84e40]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bba3a3b0-e78a-4e44-9f0f-dcc2a2abfd5d tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f904ded3-9dbf-4c64-8d2d-032b76152421 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:19 devstack sudo[100627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f904ded3-9dbf-4c64-8d2d-032b76152421 Jul 08 01:21:19 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:20 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-10e4a5fb-d968-4272-aa58-fc83747fa7e3 1073741824" returned: 0 in 2.375s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-10e4a5fb-d968-4272-aa58-fc83747fa7e3 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:20 devstack sudo[100631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-10e4a5fb-d968-4272-aa58-fc83747fa7e3 Jul 08 01:21:20 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:21 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bba3a3b0-e78a-4e44-9f0f-dcc2a2abfd5d tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f904ded3-9dbf-4c64-8d2d-032b76152421" returned: 0 in 1.765s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bba3a3b0-e78a-4e44-9f0f-dcc2a2abfd5d tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f904ded3-9dbf-4c64-8d2d-032b76152421 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:21 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f904ded3-9dbf-4c64-8d2d-032b76152421 Jul 08 01:21:21 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:21 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-10e4a5fb-d968-4272-aa58-fc83747fa7e3" returned: 0 in 1.244s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] <== create_volume: return (3742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:21:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.749s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a01b381-1bf6-416e-8e2f-3dba73897131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10e4a5fb-d968-4272-aa58-fc83747fa7e3', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138aa0b5-e933-4f4d-85a7-a3da7175181a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:21 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Volume volume-10e4a5fb-d968-4272-aa58-fc83747fa7e3 (10e4a5fb-d968-4272-aa58-fc83747fa7e3): created successfully Jul 08 01:21:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138aa0b5-e933-4f4d-85a7-a3da7175181a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Flow 'volume_create_manager' (4edf3dff-2bf8-4b0b-9e86-8d55f8bcc4cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:21:21 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-9aae9fc1-604e-4018-a79e-4ac2619cc0dc tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Created volume successfully. Jul 08 01:21:22 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bba3a3b0-e78a-4e44-9f0f-dcc2a2abfd5d tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f904ded3-9dbf-4c64-8d2d-032b76152421" returned: 0 in 1.420s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bba3a3b0-e78a-4e44-9f0f-dcc2a2abfd5d tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-f904ded3-9dbf-4c64-8d2d-032b76152421" released by "delete_volume" :: held 3.284s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:22 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-bba3a3b0-e78a-4e44-9f0f-dcc2a2abfd5d tempest-VolumesSnapshotTestJSON-1641979681 None] Created reservations ['173c31e8-d43b-47a1-92cc-acda365a8382', '4410a125-afa7-438f-bb17-77b1bb589bd5', '2b0c4f92-8f9c-4b46-8a8f-0989c1fbda6d', 'eaf174ff-a501-46c8-b1e4-725777e256f5'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:21:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bba3a3b0-e78a-4e44-9f0f-dcc2a2abfd5d tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bba3a3b0-e78a-4e44-9f0f-dcc2a2abfd5d tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:22 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bba3a3b0-e78a-4e44-9f0f-dcc2a2abfd5d tempest-VolumesSnapshotTestJSON-1641979681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:21:22 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bba3a3b0-e78a-4e44-9f0f-dcc2a2abfd5d tempest-VolumesSnapshotTestJSON-1641979681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:21:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bba3a3b0-e78a-4e44-9f0f-dcc2a2abfd5d tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bba3a3b0-e78a-4e44-9f0f-dcc2a2abfd5d tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:23 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:21:23 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7bfc6736-953c-46e1-956a-0cefbeeaa5ac tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "cinder-990edc27-9485-4114-9486-caef5cec8884-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:24 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7bfc6736-953c-46e1-956a-0cefbeeaa5ac tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-990edc27-9485-4114-9486-caef5cec8884-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7bfc6736-953c-46e1-956a-0cefbeeaa5ac tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "cinder-quobyte-7b06e074-4761-4678-9c3e-c2a8f88fe8e7" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bba3a3b0-e78a-4e44-9f0f-dcc2a2abfd5d tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.467s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:24 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-bba3a3b0-e78a-4e44-9f0f-dcc2a2abfd5d tempest-VolumesSnapshotTestJSON-1641979681 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:21:24 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-bba3a3b0-e78a-4e44-9f0f-dcc2a2abfd5d tempest-VolumesSnapshotTestJSON-1641979681 None] Deleted volume successfully. Jul 08 01:21:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7bfc6736-953c-46e1-956a-0cefbeeaa5ac tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-7b06e074-4761-4678-9c3e-c2a8f88fe8e7" acquired by "delete_snapshot" :: waited 0.061s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7bfc6736-953c-46e1-956a-0cefbeeaa5ac tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "cinder-quobyte-990edc27-9485-4114-9486-caef5cec8884" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7bfc6736-953c-46e1-956a-0cefbeeaa5ac tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-990edc27-9485-4114-9486-caef5cec8884" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-7bfc6736-953c-46e1-956a-0cefbeeaa5ac tempest-VolumesSnapshotTestJSON-1641979681 None] Deleting offline snapshot 990edc27-9485-4114-9486-caef5cec8884 of volume 7b06e074-4761-4678-9c3e-c2a8f88fe8e7 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:21:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-7bfc6736-953c-46e1-956a-0cefbeeaa5ac tempest-VolumesSnapshotTestJSON-1641979681 None] snapshot_file for this snap is: volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.990edc27-9485-4114-9486-caef5cec8884 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:21:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bba3a3b0-e78a-4e44-9f0f-dcc2a2abfd5d tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-f904ded3-9dbf-4c64-8d2d-032b76152421-delete_volume" released by "delete_volume" :: held 5.340s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:24 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f01c415-cbda-4ac8-abad-12ef56c6e679]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7bfc6736-953c-46e1-956a-0cefbeeaa5ac tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.990edc27-9485-4114-9486-caef5cec8884 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:24 devstack sudo[100648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.990edc27-9485-4114-9486-caef5cec8884 Jul 08 01:21:24 devstack sudo[100648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:25 devstack sudo[100648]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7bfc6736-953c-46e1-956a-0cefbeeaa5ac tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.990edc27-9485-4114-9486-caef5cec8884" returned: 0 in 1.397s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-7bfc6736-953c-46e1-956a-0cefbeeaa5ac tempest-VolumesSnapshotTestJSON-1641979681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:21:26 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c0ad81-7fa5-4e86-bb12-21788b423409]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7bfc6736-953c-46e1-956a-0cefbeeaa5ac tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:26 devstack sudo[100654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7 Jul 08 01:21:26 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-62f0d6dd-4ee6-456b-b1ff-bf21cde2459a req-3ae60392-644e-4113-bd2c-ce01d76429d4 tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-62f0d6dd-4ee6-456b-b1ff-bf21cde2459a req-3ae60392-644e-4113-bd2c-ce01d76429d4 tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:27 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[0789ae28-3149-4875-b965-90e41057d711]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-62f0d6dd-4ee6-456b-b1ff-bf21cde2459a req-3ae60392-644e-4113-bd2c-ce01d76429d4 tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-10e4a5fb-d968-4272-aa58-fc83747fa7e3 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:27 devstack sudo[100688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-10e4a5fb-d968-4272-aa58-fc83747fa7e3 Jul 08 01:21:27 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:27 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:21:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Flow 'volume_create_manager' (90150f3e-5027-4e92-b326-6dc5443037d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:21:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50dd416b-176d-4dd5-ab16-a934e27bb328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50dd416b-176d-4dd5-ab16-a934e27bb328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1503410122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfcb1279-1adf-460f-8a50-ee507a6fb22c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42274406b940457886e4b0a7a41b4a8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:21:27Z,use_quota=True,user_id='cdc97d725eec462291577276ac24b2c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626ad4b9-0aeb-4055-981f-e5528b9b5f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626ad4b9-0aeb-4055-981f-e5528b9b5f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d671ede5-4998-4a93-9cbd-42ca23623da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d671ede5-4998-4a93-9cbd-42ca23623da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfcb1279-1adf-460f-8a50-ee507a6fb22c', 'volume_name': 'volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f17189c-a161-4c65-bd5b-ac86a8e0e554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f17189c-a161-4c65-bd5b-ac86a8e0e554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb53b497-4f77-45e5-b629-f862d0be37a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:27 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Volume cfcb1279-1adf-460f-8a50-ee507a6fb22c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c', 'volume_size': 1} Jul 08 01:21:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:28 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7bfc6736-953c-46e1-956a-0cefbeeaa5ac tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7" returned: 0 in 2.417s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7bfc6736-953c-46e1-956a-0cefbeeaa5ac tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.990edc27-9485-4114-9486-caef5cec8884 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:28 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.990edc27-9485-4114-9486-caef5cec8884 Jul 08 01:21:28 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:28 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-62f0d6dd-4ee6-456b-b1ff-bf21cde2459a req-3ae60392-644e-4113-bd2c-ce01d76429d4 tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-10e4a5fb-d968-4272-aa58-fc83747fa7e3" returned: 0 in 1.386s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-62f0d6dd-4ee6-456b-b1ff-bf21cde2459a req-3ae60392-644e-4113-bd2c-ce01d76429d4 tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.445s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.855s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:28 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1503410122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfcb1279-1adf-460f-8a50-ee507a6fb22c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42274406b940457886e4b0a7a41b4a8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:21:27Z,use_quota=True,user_id='cdc97d725eec462291577276ac24b2c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:21:28 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Creating volume cfcb1279-1adf-460f-8a50-ee507a6fb22c {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:21:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:28 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:21:28 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:21:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:28 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:21:28 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:21:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:28 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c 1073741824 Jul 08 01:21:28 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:28 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-62f0d6dd-4ee6-456b-b1ff-bf21cde2459a req-3ae60392-644e-4113-bd2c-ce01d76429d4 tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d', 'name': 'volume-10e4a5fb-d968-4272-aa58-fc83747fa7e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5d62e264-904c-46c4-b733-852ad8f3f37a', 'enforce_multipath': True} {{(pid=87022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:21:28 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-62f0d6dd-4ee6-456b-b1ff-bf21cde2459a req-3ae60392-644e-4113-bd2c-ce01d76429d4 tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] attachment_update completed successfully. Jul 08 01:21:29 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7bfc6736-953c-46e1-956a-0cefbeeaa5ac tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.990edc27-9485-4114-9486-caef5cec8884" returned: 0 in 1.437s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7bfc6736-953c-46e1-956a-0cefbeeaa5ac tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.990edc27-9485-4114-9486-caef5cec8884 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:29 devstack sudo[100710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.990edc27-9485-4114-9486-caef5cec8884 Jul 08 01:21:29 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:30 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c 1073741824" returned: 0 in 2.255s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:30 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c Jul 08 01:21:30 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:31 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7bfc6736-953c-46e1-956a-0cefbeeaa5ac tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7.990edc27-9485-4114-9486-caef5cec8884" returned: 0 in 1.352s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7bfc6736-953c-46e1-956a-0cefbeeaa5ac tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-990edc27-9485-4114-9486-caef5cec8884" released by "_delete_snapshot" :: held 6.806s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7bfc6736-953c-46e1-956a-0cefbeeaa5ac tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-7b06e074-4761-4678-9c3e-c2a8f88fe8e7" released by "delete_snapshot" :: held 6.853s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:31 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-7bfc6736-953c-46e1-956a-0cefbeeaa5ac tempest-VolumesSnapshotTestJSON-1641979681 None] Created reservations ['3fb7e1f2-b1c6-4041-9f43-4af96d5c23fd', 'c6df144e-a72a-44fd-a475-54cbc70c3d9b', '2b98ab36-e59c-4e10-8c8b-dddb5a7b66f4', '82f7e02b-9ae6-44da-8e66-04bf692673cf'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:21:31 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-7bfc6736-953c-46e1-956a-0cefbeeaa5ac tempest-VolumesSnapshotTestJSON-1641979681 None] Delete snapshot completed successfully. Jul 08 01:21:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7bfc6736-953c-46e1-956a-0cefbeeaa5ac tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-990edc27-9485-4114-9486-caef5cec8884-delete_snapshot" released by "delete_snapshot" :: held 7.340s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:32 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c" returned: 0 in 1.296s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:32 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] <== create_volume: return (3639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:21:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.647s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:32 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb53b497-4f77-45e5-b629-f862d0be37a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:32 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bcc0ddd-d8a6-4713-8b82-d86e1e97ebf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:32 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Volume volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c (cfcb1279-1adf-460f-8a50-ee507a6fb22c): created successfully Jul 08 01:21:32 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bcc0ddd-d8a6-4713-8b82-d86e1e97ebf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:32 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Flow 'volume_create_manager' (90150f3e-5027-4e92-b326-6dc5443037d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:21:32 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-3f9a4106-bed5-45ff-929f-308484c5c1b2 tempest-TestStampPattern-1012369784 None] Created volume successfully. Jul 08 01:21:32 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0bd799f7-fb57-4e24-ad87-cb02e6511b0a tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "cinder-7b06e074-4761-4678-9c3e-c2a8f88fe8e7-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:32 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0bd799f7-fb57-4e24-ad87-cb02e6511b0a tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-7b06e074-4761-4678-9c3e-c2a8f88fe8e7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:32 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0bd799f7-fb57-4e24-ad87-cb02e6511b0a tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "cinder-quobyte-7b06e074-4761-4678-9c3e-c2a8f88fe8e7" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:32 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0bd799f7-fb57-4e24-ad87-cb02e6511b0a tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-7b06e074-4761-4678-9c3e-c2a8f88fe8e7" acquired by "delete_volume" :: waited 0.024s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:32 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9843e7a-0aa6-47cd-81f1-38354617dc2f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0bd799f7-fb57-4e24-ad87-cb02e6511b0a tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:32 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7 Jul 08 01:21:32 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:33 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0bd799f7-fb57-4e24-ad87-cb02e6511b0a tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7" returned: 0 in 1.176s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0bd799f7-fb57-4e24-ad87-cb02e6511b0a tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:33 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7 Jul 08 01:21:33 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:34 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0bd799f7-fb57-4e24-ad87-cb02e6511b0a tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b06e074-4761-4678-9c3e-c2a8f88fe8e7" returned: 0 in 0.746s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:34 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0bd799f7-fb57-4e24-ad87-cb02e6511b0a tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-7b06e074-4761-4678-9c3e-c2a8f88fe8e7" released by "delete_volume" :: held 2.035s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:34 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-0bd799f7-fb57-4e24-ad87-cb02e6511b0a tempest-VolumesSnapshotTestJSON-1641979681 None] Created reservations ['dde3858c-c9c2-4365-910d-9d0d57f492eb', 'c7ff2093-6d26-4f4f-96cc-2c4fa29ee046', 'f4cca1b4-1476-41c7-827f-0d3583758103', 'ac91a798-51ee-4f6e-8bc8-93b8b4a7f54e'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:21:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-0bd799f7-fb57-4e24-ad87-cb02e6511b0a tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-0bd799f7-fb57-4e24-ad87-cb02e6511b0a tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:34 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-0bd799f7-fb57-4e24-ad87-cb02e6511b0a tempest-VolumesSnapshotTestJSON-1641979681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:21:34 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-0bd799f7-fb57-4e24-ad87-cb02e6511b0a tempest-VolumesSnapshotTestJSON-1641979681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:21:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-0bd799f7-fb57-4e24-ad87-cb02e6511b0a tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0bd799f7-fb57-4e24-ad87-cb02e6511b0a tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:34 devstack sudo[100814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:21:34 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:35 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0bd799f7-fb57-4e24-ad87-cb02e6511b0a tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.682s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:35 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-0bd799f7-fb57-4e24-ad87-cb02e6511b0a tempest-VolumesSnapshotTestJSON-1641979681 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:21:35 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-0bd799f7-fb57-4e24-ad87-cb02e6511b0a tempest-VolumesSnapshotTestJSON-1641979681 None] Deleted volume successfully. Jul 08 01:21:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0bd799f7-fb57-4e24-ad87-cb02e6511b0a tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-7b06e074-4761-4678-9c3e-c2a8f88fe8e7-delete_volume" released by "delete_volume" :: held 2.997s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5c74075d-9361-4ece-96a1-097138d5b3a4 tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "cinder-f3c27c6f-fcbc-4b40-a766-aa7e96e05888-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:35 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-ebaa05d0-89a1-4530-949a-1201eccd4795 req-8821fc4a-c4bf-49e5-ae91-94ee1abc3605 tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Terminate volume connection completed successfully. Jul 08 01:21:35 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-ebaa05d0-89a1-4530-949a-1201eccd4795 req-8821fc4a-c4bf-49e5-ae91-94ee1abc3605 tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Deleting attachment 5d62e264-904c-46c4-b733-852ad8f3f37a. {{(pid=87022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:21:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5c74075d-9361-4ece-96a1-097138d5b3a4 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-f3c27c6f-fcbc-4b40-a766-aa7e96e05888-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5c74075d-9361-4ece-96a1-097138d5b3a4 tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "cinder-quobyte-f3c27c6f-fcbc-4b40-a766-aa7e96e05888" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5c74075d-9361-4ece-96a1-097138d5b3a4 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-f3c27c6f-fcbc-4b40-a766-aa7e96e05888" acquired by "delete_volume" :: waited 0.019s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:35 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[817e48e3-d89a-4a1c-aca0-ce4bc18ba217]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5c74075d-9361-4ece-96a1-097138d5b3a4 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:36 devstack sudo[100819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888 Jul 08 01:21:36 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:36 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5c74075d-9361-4ece-96a1-097138d5b3a4 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888" returned: 0 in 0.940s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5c74075d-9361-4ece-96a1-097138d5b3a4 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:36 devstack sudo[100825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888 Jul 08 01:21:36 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:37 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5c74075d-9361-4ece-96a1-097138d5b3a4 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f3c27c6f-fcbc-4b40-a766-aa7e96e05888" returned: 0 in 0.798s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:37 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5c74075d-9361-4ece-96a1-097138d5b3a4 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-quobyte-f3c27c6f-fcbc-4b40-a766-aa7e96e05888" released by "delete_volume" :: held 1.805s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:37 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-5c74075d-9361-4ece-96a1-097138d5b3a4 tempest-VolumesSnapshotTestJSON-1641979681 None] Created reservations ['7cdceb1a-ab23-48c3-863a-8ec61140039e', 'c1eb9819-96e8-4624-bb7d-7136d8b58664', '6089aa98-c22b-49bb-bc77-862db9a8e41f', '3f726437-2cf3-4ea8-b13d-600237f9e505'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:21:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5c74075d-9361-4ece-96a1-097138d5b3a4 tempest-VolumesSnapshotTestJSON-1641979681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5c74075d-9361-4ece-96a1-097138d5b3a4 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:37 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5c74075d-9361-4ece-96a1-097138d5b3a4 tempest-VolumesSnapshotTestJSON-1641979681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:21:37 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5c74075d-9361-4ece-96a1-097138d5b3a4 tempest-VolumesSnapshotTestJSON-1641979681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:21:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5c74075d-9361-4ece-96a1-097138d5b3a4 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5c74075d-9361-4ece-96a1-097138d5b3a4 tempest-VolumesSnapshotTestJSON-1641979681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:37 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:21:37 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:37 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2c55bc98-b5cc-40d8-bbc3-a9f0f8e45d53 tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Acquiring lock "cinder-10e4a5fb-d968-4272-aa58-fc83747fa7e3-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:38 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2c55bc98-b5cc-40d8-bbc3-a9f0f8e45d53 tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Lock "cinder-10e4a5fb-d968-4272-aa58-fc83747fa7e3-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:38 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2c55bc98-b5cc-40d8-bbc3-a9f0f8e45d53 tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Acquiring lock "cinder-quobyte-10e4a5fb-d968-4272-aa58-fc83747fa7e3" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:38 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2c55bc98-b5cc-40d8-bbc3-a9f0f8e45d53 tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Lock "cinder-quobyte-10e4a5fb-d968-4272-aa58-fc83747fa7e3" acquired by "delete_volume" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:38 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce799a93-76a1-4bfd-b125-96371ff25067]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2c55bc98-b5cc-40d8-bbc3-a9f0f8e45d53 tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-10e4a5fb-d968-4272-aa58-fc83747fa7e3 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:38 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-10e4a5fb-d968-4272-aa58-fc83747fa7e3 Jul 08 01:21:38 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:39 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5c74075d-9361-4ece-96a1-097138d5b3a4 tempest-VolumesSnapshotTestJSON-1641979681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.159s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:39 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-5c74075d-9361-4ece-96a1-097138d5b3a4 tempest-VolumesSnapshotTestJSON-1641979681 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:21:39 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-5c74075d-9361-4ece-96a1-097138d5b3a4 tempest-VolumesSnapshotTestJSON-1641979681 None] Deleted volume successfully. Jul 08 01:21:39 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5c74075d-9361-4ece-96a1-097138d5b3a4 tempest-VolumesSnapshotTestJSON-1641979681 None] Lock "cinder-f3c27c6f-fcbc-4b40-a766-aa7e96e05888-delete_volume" released by "delete_volume" :: held 3.223s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:39 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2c55bc98-b5cc-40d8-bbc3-a9f0f8e45d53 tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-10e4a5fb-d968-4272-aa58-fc83747fa7e3" returned: 0 in 1.132s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2c55bc98-b5cc-40d8-bbc3-a9f0f8e45d53 tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-10e4a5fb-d968-4272-aa58-fc83747fa7e3 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:39 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-10e4a5fb-d968-4272-aa58-fc83747fa7e3 Jul 08 01:21:39 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:40 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2c55bc98-b5cc-40d8-bbc3-a9f0f8e45d53 tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-10e4a5fb-d968-4272-aa58-fc83747fa7e3" returned: 0 in 0.718s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:40 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2c55bc98-b5cc-40d8-bbc3-a9f0f8e45d53 tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Lock "cinder-quobyte-10e4a5fb-d968-4272-aa58-fc83747fa7e3" released by "delete_volume" :: held 1.931s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:40 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-2c55bc98-b5cc-40d8-bbc3-a9f0f8e45d53 tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Created reservations ['630bb0b4-8a72-46d5-ad24-26ff628bf836', 'dae0ead7-809a-4ed6-a508-8a29ebffddf0', 'e0cee461-90f5-4bb7-bcd9-2b568ea7f8ff', '4670cfa2-2b2e-4cc9-b77d-dd26c531f0fd'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:21:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2c55bc98-b5cc-40d8-bbc3-a9f0f8e45d53 tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2c55bc98-b5cc-40d8-bbc3-a9f0f8e45d53 tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:40 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-2c55bc98-b5cc-40d8-bbc3-a9f0f8e45d53 tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:21:40 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-2c55bc98-b5cc-40d8-bbc3-a9f0f8e45d53 tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:21:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2c55bc98-b5cc-40d8-bbc3-a9f0f8e45d53 tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2c55bc98-b5cc-40d8-bbc3-a9f0f8e45d53 tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:40 devstack sudo[100860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:21:40 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:41 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2c55bc98-b5cc-40d8-bbc3-a9f0f8e45d53 tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.898s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:41 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-2c55bc98-b5cc-40d8-bbc3-a9f0f8e45d53 tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:21:41 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-2c55bc98-b5cc-40d8-bbc3-a9f0f8e45d53 tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Deleted volume successfully. Jul 08 01:21:41 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2c55bc98-b5cc-40d8-bbc3-a9f0f8e45d53 tempest-TestServerVolumeAttachScenarioOldVersion-1057178783 None] Lock "cinder-10e4a5fb-d968-4272-aa58-fc83747fa7e3-delete_volume" released by "delete_volume" :: held 3.425s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:45 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:21:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:21:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:21:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:45 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:21:45 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:47 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.658s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:47 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:21:47 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:21:47 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread count: 28 {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:21:47 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread info: [<_MainThread(MainThread, started 134382216167552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:21:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-6376f3cc-83ab-4483-ac05-53fbcc423adc req-674a2efa-a87d-4d57-99ec-eae6452df099 tempest-TestInstancesWithCinderVolumes-269993021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-6376f3cc-83ab-4483-ac05-53fbcc423adc req-674a2efa-a87d-4d57-99ec-eae6452df099 tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:48 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c67b11f-1a40-413e-a488-4e51cbfa35e5]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-6376f3cc-83ab-4483-ac05-53fbcc423adc req-674a2efa-a87d-4d57-99ec-eae6452df099 tempest-TestInstancesWithCinderVolumes-269993021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83eb3da9-9422-45cb-9620-8baed7a85580 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:48 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83eb3da9-9422-45cb-9620-8baed7a85580 Jul 08 01:21:48 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:50 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:21:50 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Flow 'volume_create_manager' (07477abb-1e9e-427d-bf27-d99f86ebb4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:21:50 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e22a8d-39c3-4ac7-b339-28d68a26ae79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:50 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-6376f3cc-83ab-4483-ac05-53fbcc423adc req-674a2efa-a87d-4d57-99ec-eae6452df099 tempest-TestInstancesWithCinderVolumes-269993021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83eb3da9-9422-45cb-9620-8baed7a85580" returned: 0 in 1.942s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-6376f3cc-83ab-4483-ac05-53fbcc423adc req-674a2efa-a87d-4d57-99ec-eae6452df099 tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.995s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:50 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e22a8d-39c3-4ac7-b339-28d68a26ae79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-515206627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e46d598c-331d-46f0-ab7b-37e22cac8fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d09bd72ce4504c25bb14e875528ca0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:21:50Z,use_quota=True,user_id='7db9e9e4bb3c4772813e35c1eb5b7590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:50 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9cda31c-2252-4c71-a524-410869c349c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:50 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9cda31c-2252-4c71-a524-410869c349c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:50 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4c1f55-c80b-4bae-895f-9372d8aff586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:50 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4c1f55-c80b-4bae-895f-9372d8aff586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e46d598c-331d-46f0-ab7b-37e22cac8fae', 'volume_name': 'volume-e46d598c-331d-46f0-ab7b-37e22cac8fae', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:50 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (391a0a5e-7631-44a2-8f1e-522ef9dbcbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:50 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (391a0a5e-7631-44a2-8f1e-522ef9dbcbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:50 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a036942-7f4b-441d-8687-67438edb343d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:50 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Volume e46d598c-331d-46f0-ab7b-37e22cac8fae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e46d598c-331d-46f0-ab7b-37e22cac8fae', 'volume_size': 1} Jul 08 01:21:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:50 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-515206627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e46d598c-331d-46f0-ab7b-37e22cac8fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d09bd72ce4504c25bb14e875528ca0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:21:50Z,use_quota=True,user_id='7db9e9e4bb3c4772813e35c1eb5b7590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:21:50 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Creating volume e46d598c-331d-46f0-ab7b-37e22cac8fae {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:21:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:50 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:21:50 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:21:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:50 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:21:50 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:21:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:50 devstack sudo[100978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae 1073741824 Jul 08 01:21:50 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:50 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-6376f3cc-83ab-4483-ac05-53fbcc423adc req-674a2efa-a87d-4d57-99ec-eae6452df099 tempest-TestInstancesWithCinderVolumes-269993021 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d', 'name': 'volume-83eb3da9-9422-45cb-9620-8baed7a85580', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '383c6204-ca28-4280-af0c-196868c3d375', 'enforce_multipath': True} {{(pid=87022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:21:50 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-6376f3cc-83ab-4483-ac05-53fbcc423adc req-674a2efa-a87d-4d57-99ec-eae6452df099 tempest-TestInstancesWithCinderVolumes-269993021 None] attachment_update completed successfully. Jul 08 01:21:51 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae 1073741824" returned: 0 in 1.297s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:51 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae Jul 08 01:21:51 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:52 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae" returned: 0 in 0.944s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] <== create_volume: return (2339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:21:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.343s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a036942-7f4b-441d-8687-67438edb343d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e46d598c-331d-46f0-ab7b-37e22cac8fae', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93727452-dd59-4522-b78f-a993019d39ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:52 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Volume volume-e46d598c-331d-46f0-ab7b-37e22cac8fae (e46d598c-331d-46f0-ab7b-37e22cac8fae): created successfully Jul 08 01:21:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93727452-dd59-4522-b78f-a993019d39ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Flow 'volume_create_manager' (07477abb-1e9e-427d-bf27-d99f86ebb4da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:21:52 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-229ea6a9-5ead-4fa1-983f-7ef167630041 tempest-VolumesSnapshotListTestJSON-1878864291 None] Created volume successfully. Jul 08 01:21:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-fe28d698-c0e0-4208-a1b6-241380c03616 tempest-VolumesSnapshotListTestJSON-1878864291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-fe28d698-c0e0-4208-a1b6-241380c03616 tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:53 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-fe28d698-c0e0-4208-a1b6-241380c03616 tempest-VolumesSnapshotListTestJSON-1878864291 None] Creating offline snapshot 13a5e3c8-5ef7-41e7-9fef-0765b905030a of volume e46d598c-331d-46f0-ab7b-37e22cac8fae {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:21:53 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae93425c-88fd-4af6-ade2-de9c022addd8]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fe28d698-c0e0-4208-a1b6-241380c03616 tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:53 devstack sudo[100991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae Jul 08 01:21:53 devstack sudo[100991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:54 devstack sudo[100991]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fe28d698-c0e0-4208-a1b6-241380c03616 tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae" returned: 0 in 1.226s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fe28d698-c0e0-4208-a1b6-241380c03616 tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:54 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a 1G Jul 08 01:21:54 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:56 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fe28d698-c0e0-4208-a1b6-241380c03616 tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a 1G" returned: 0 in 1.227s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fe28d698-c0e0-4208-a1b6-241380c03616 tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e46d598c-331d-46f0-ab7b-37e22cac8fae -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:56 devstack sudo[101009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e46d598c-331d-46f0-ab7b-37e22cac8fae -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a Jul 08 01:21:56 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:57 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fe28d698-c0e0-4208-a1b6-241380c03616 tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e46d598c-331d-46f0-ab7b-37e22cac8fae -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a" returned: 0 in 1.051s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:57 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-fe28d698-c0e0-4208-a1b6-241380c03616 tempest-VolumesSnapshotListTestJSON-1878864291 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a is being set with open permissions: ugo+rw Jul 08 01:21:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fe28d698-c0e0-4208-a1b6-241380c03616 tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:57 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a Jul 08 01:21:57 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:57 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fe28d698-c0e0-4208-a1b6-241380c03616 tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a" returned: 0 in 0.763s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fe28d698-c0e0-4208-a1b6-241380c03616 tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:58 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.info Jul 08 01:21:58 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:58 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fe28d698-c0e0-4208-a1b6-241380c03616 tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.info" returned: 0 in 0.853s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:58 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-fe28d698-c0e0-4208-a1b6-241380c03616 tempest-VolumesSnapshotListTestJSON-1878864291 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.info is being set with open permissions: ugo+rw Jul 08 01:21:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fe28d698-c0e0-4208-a1b6-241380c03616 tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:58 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.info Jul 08 01:21:58 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:59 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fe28d698-c0e0-4208-a1b6-241380c03616 tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.info" returned: 0 in 0.775s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-fe28d698-c0e0-4208-a1b6-241380c03616 tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:59 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-fe28d698-c0e0-4208-a1b6-241380c03616 tempest-VolumesSnapshotListTestJSON-1878864291 None] Create snapshot completed successfully Jul 08 01:21:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-5d61efd7-d6d8-496f-a785-7313a493a859 req-d09cfed6-dd91-40a9-a3a2-85f1d4c70689 tempest-TestInstancesWithCinderVolumes-269993021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-5d61efd7-d6d8-496f-a785-7313a493a859 req-d09cfed6-dd91-40a9-a3a2-85f1d4c70689 tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:59 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b997404a-b883-49f2-836e-1e128aa21abc]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-5d61efd7-d6d8-496f-a785-7313a493a859 req-d09cfed6-dd91-40a9-a3a2-85f1d4c70689 tempest-TestInstancesWithCinderVolumes-269993021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83805664-bb82-4422-bbb0-413edd8964ca {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:59 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83805664-bb82-4422-bbb0-413edd8964ca Jul 08 01:21:59 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-811bbb96-1001-4223-8da6-bf69f3fd9754 tempest-VolumesSnapshotListTestJSON-1878864291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:00 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-5d61efd7-d6d8-496f-a785-7313a493a859 req-d09cfed6-dd91-40a9-a3a2-85f1d4c70689 tempest-TestInstancesWithCinderVolumes-269993021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83805664-bb82-4422-bbb0-413edd8964ca" returned: 0 in 0.877s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-5d61efd7-d6d8-496f-a785-7313a493a859 req-d09cfed6-dd91-40a9-a3a2-85f1d4c70689 tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.895s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-811bbb96-1001-4223-8da6-bf69f3fd9754 tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.406s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:00 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-811bbb96-1001-4223-8da6-bf69f3fd9754 tempest-VolumesSnapshotListTestJSON-1878864291 None] Creating offline snapshot acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19 of volume e46d598c-331d-46f0-ab7b-37e22cac8fae {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:22:00 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1513f0-437e-4521-8001-56be71c51d19]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-811bbb96-1001-4223-8da6-bf69f3fd9754 tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-5d61efd7-d6d8-496f-a785-7313a493a859 req-d09cfed6-dd91-40a9-a3a2-85f1d4c70689 tempest-TestInstancesWithCinderVolumes-269993021 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d', 'name': 'volume-83805664-bb82-4422-bbb0-413edd8964ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1162955c-ab8e-4bf8-a82e-82d2a5a581df', 'enforce_multipath': True} {{(pid=87022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:22:00 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-5d61efd7-d6d8-496f-a785-7313a493a859 req-d09cfed6-dd91-40a9-a3a2-85f1d4c70689 tempest-TestInstancesWithCinderVolumes-269993021 None] attachment_update completed successfully. Jul 08 01:22:00 devstack sudo[101067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a Jul 08 01:22:00 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:01 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-811bbb96-1001-4223-8da6-bf69f3fd9754 tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a" returned: 0 in 0.993s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-811bbb96-1001-4223-8da6-bf69f3fd9754 tempest-VolumesSnapshotListTestJSON-1878864291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e46d598c-331d-46f0-ab7b-37e22cac8fae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:22:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-811bbb96-1001-4223-8da6-bf69f3fd9754 tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:01 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19 1G Jul 08 01:22:01 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:02 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-811bbb96-1001-4223-8da6-bf69f3fd9754 tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19 1G" returned: 0 in 1.027s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-811bbb96-1001-4223-8da6-bf69f3fd9754 tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:02 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19 Jul 08 01:22:02 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:03 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-811bbb96-1001-4223-8da6-bf69f3fd9754 tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19" returned: 0 in 0.886s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:03 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-811bbb96-1001-4223-8da6-bf69f3fd9754 tempest-VolumesSnapshotListTestJSON-1878864291 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19 is being set with open permissions: ugo+rw Jul 08 01:22:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-811bbb96-1001-4223-8da6-bf69f3fd9754 tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:03 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19 Jul 08 01:22:03 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:04 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-811bbb96-1001-4223-8da6-bf69f3fd9754 tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19" returned: 0 in 0.745s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-811bbb96-1001-4223-8da6-bf69f3fd9754 tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.768s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:04 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-811bbb96-1001-4223-8da6-bf69f3fd9754 tempest-VolumesSnapshotListTestJSON-1878864291 None] Create snapshot completed successfully Jul 08 01:22:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-987b818e-1513-4b3e-bce6-9d5c6fced0a8 tempest-VolumesSnapshotListTestJSON-1878864291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-987b818e-1513-4b3e-bce6-9d5c6fced0a8 tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:05 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:22:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Flow 'volume_create_manager' (1dbdd5b8-516b-48db-a73e-057b08ea484e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:22:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (449cb1b7-bfa1-4c51-8b46-823212d2982a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:05 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-987b818e-1513-4b3e-bce6-9d5c6fced0a8 tempest-VolumesSnapshotListTestJSON-1878864291 None] Creating offline snapshot 6fc3368a-58ca-455f-b734-f784006268f6 of volume e46d598c-331d-46f0-ab7b-37e22cac8fae {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:22:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (449cb1b7-bfa1-4c51-8b46-823212d2982a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-525460534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5f96fe-f083-411c-b22a-aeafc3dc89fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fef19ddef1f442093657660791a7532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:22:06Z,use_quota=True,user_id='fcdfefd8d5d8422ea9f85a93f7a2e434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b2324dd-87b4-4b82-96c8-92e7b2687502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b2324dd-87b4-4b82-96c8-92e7b2687502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f039b86-a0ab-483a-9254-6264c1ae54b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f039b86-a0ab-483a-9254-6264c1ae54b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f5f96fe-f083-411c-b22a-aeafc3dc89fd', 'volume_name': 'volume-4f5f96fe-f083-411c-b22a-aeafc3dc89fd', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86eba738-9f84-4d14-85d4-92c907b1d670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86eba738-9f84-4d14-85d4-92c907b1d670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce0d841-7fca-4d01-b30d-e54f955cff89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:06 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Volume 4f5f96fe-f083-411c-b22a-aeafc3dc89fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f5f96fe-f083-411c-b22a-aeafc3dc89fd', 'volume_size': 1} Jul 08 01:22:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:06 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b670f9-87d0-475b-aa67-235f83d495b7]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-987b818e-1513-4b3e-bce6-9d5c6fced0a8 tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:06 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19 Jul 08 01:22:06 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:06 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-987b818e-1513-4b3e-bce6-9d5c6fced0a8 tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19" returned: 0 in 0.895s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:06 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-987b818e-1513-4b3e-bce6-9d5c6fced0a8 tempest-VolumesSnapshotListTestJSON-1878864291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e46d598c-331d-46f0-ab7b-37e22cac8fae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:22:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-987b818e-1513-4b3e-bce6-9d5c6fced0a8 tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.6fc3368a-58ca-455f-b734-f784006268f6 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:06 devstack sudo[101106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.6fc3368a-58ca-455f-b734-f784006268f6 1G Jul 08 01:22:06 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:08 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-987b818e-1513-4b3e-bce6-9d5c6fced0a8 tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.6fc3368a-58ca-455f-b734-f784006268f6 1G" returned: 0 in 1.202s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-987b818e-1513-4b3e-bce6-9d5c6fced0a8 tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.6fc3368a-58ca-455f-b734-f784006268f6 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:08 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.6fc3368a-58ca-455f-b734-f784006268f6 Jul 08 01:22:08 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:08 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-987b818e-1513-4b3e-bce6-9d5c6fced0a8 tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.6fc3368a-58ca-455f-b734-f784006268f6" returned: 0 in 0.775s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:08 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-987b818e-1513-4b3e-bce6-9d5c6fced0a8 tempest-VolumesSnapshotListTestJSON-1878864291 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.6fc3368a-58ca-455f-b734-f784006268f6 is being set with open permissions: ugo+rw Jul 08 01:22:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-987b818e-1513-4b3e-bce6-9d5c6fced0a8 tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.6fc3368a-58ca-455f-b734-f784006268f6 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:08 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.6fc3368a-58ca-455f-b734-f784006268f6 Jul 08 01:22:08 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:09 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-987b818e-1513-4b3e-bce6-9d5c6fced0a8 tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.6fc3368a-58ca-455f-b734-f784006268f6" returned: 0 in 0.673s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-987b818e-1513-4b3e-bce6-9d5c6fced0a8 tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.733s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.587s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-525460534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5f96fe-f083-411c-b22a-aeafc3dc89fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fef19ddef1f442093657660791a7532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:22:06Z,use_quota=True,user_id='fcdfefd8d5d8422ea9f85a93f7a2e434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:22:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Creating volume 4f5f96fe-f083-411c-b22a-aeafc3dc89fd {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:22:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:22:09 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:22:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4f5f96fe-f083-411c-b22a-aeafc3dc89fd 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:09 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4f5f96fe-f083-411c-b22a-aeafc3dc89fd 1073741824 Jul 08 01:22:09 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:09 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-987b818e-1513-4b3e-bce6-9d5c6fced0a8 tempest-VolumesSnapshotListTestJSON-1878864291 None] Create snapshot completed successfully Jul 08 01:22:10 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-6167c92e-3b79-462d-9ebe-191f114195be req-5aa1cec3-fde3-4610-bd91-2d860a722e27 tempest-TestInstancesWithCinderVolumes-269993021 None] Terminate volume connection completed successfully. Jul 08 01:22:10 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-6167c92e-3b79-462d-9ebe-191f114195be req-5aa1cec3-fde3-4610-bd91-2d860a722e27 tempest-TestInstancesWithCinderVolumes-269993021 None] Deleting attachment 383c6204-ca28-4280-af0c-196868c3d375. {{(pid=87022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:22:10 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4f5f96fe-f083-411c-b22a-aeafc3dc89fd 1073741824" returned: 0 in 1.004s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4f5f96fe-f083-411c-b22a-aeafc3dc89fd {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:10 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4f5f96fe-f083-411c-b22a-aeafc3dc89fd Jul 08 01:22:10 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:10 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d62b62a7-25c0-423f-b8eb-8a0c22b0a295 tempest-VolumesSnapshotListTestJSON-1878864291 None] Acquiring lock "cinder-6fc3368a-58ca-455f-b734-f784006268f6-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:10 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d62b62a7-25c0-423f-b8eb-8a0c22b0a295 tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "cinder-6fc3368a-58ca-455f-b734-f784006268f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:10 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d62b62a7-25c0-423f-b8eb-8a0c22b0a295 tempest-VolumesSnapshotListTestJSON-1878864291 None] Acquiring lock "cinder-quobyte-e46d598c-331d-46f0-ab7b-37e22cac8fae" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:10 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d62b62a7-25c0-423f-b8eb-8a0c22b0a295 tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "cinder-quobyte-e46d598c-331d-46f0-ab7b-37e22cac8fae" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:10 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d62b62a7-25c0-423f-b8eb-8a0c22b0a295 tempest-VolumesSnapshotListTestJSON-1878864291 None] Acquiring lock "cinder-quobyte-6fc3368a-58ca-455f-b734-f784006268f6" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:10 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d62b62a7-25c0-423f-b8eb-8a0c22b0a295 tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "cinder-quobyte-6fc3368a-58ca-455f-b734-f784006268f6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-d62b62a7-25c0-423f-b8eb-8a0c22b0a295 tempest-VolumesSnapshotListTestJSON-1878864291 None] Deleting offline snapshot 6fc3368a-58ca-455f-b734-f784006268f6 of volume e46d598c-331d-46f0-ab7b-37e22cac8fae {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:22:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-d62b62a7-25c0-423f-b8eb-8a0c22b0a295 tempest-VolumesSnapshotListTestJSON-1878864291 None] snapshot_file for this snap is: volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.6fc3368a-58ca-455f-b734-f784006268f6 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:22:10 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b991cbc6-d104-4532-b7f1-88b25a6e5e32]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d62b62a7-25c0-423f-b8eb-8a0c22b0a295 tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.6fc3368a-58ca-455f-b734-f784006268f6 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:10 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.6fc3368a-58ca-455f-b734-f784006268f6 Jul 08 01:22:10 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:11 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4f5f96fe-f083-411c-b22a-aeafc3dc89fd" returned: 0 in 0.701s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:11 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:22:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce0d841-7fca-4d01-b30d-e54f955cff89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f5f96fe-f083-411c-b22a-aeafc3dc89fd', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bee80eb-9e5a-439e-b52b-5f5a0d1f1a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:11 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Volume volume-4f5f96fe-f083-411c-b22a-aeafc3dc89fd (4f5f96fe-f083-411c-b22a-aeafc3dc89fd): created successfully Jul 08 01:22:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bee80eb-9e5a-439e-b52b-5f5a0d1f1a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Flow 'volume_create_manager' (1dbdd5b8-516b-48db-a73e-057b08ea484e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:22:11 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-e098a23a-018f-4220-8e96-16bb162d8fe8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Created volume successfully. Jul 08 01:22:11 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d62b62a7-25c0-423f-b8eb-8a0c22b0a295 tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.6fc3368a-58ca-455f-b734-f784006268f6" returned: 0 in 0.817s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:11 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-d62b62a7-25c0-423f-b8eb-8a0c22b0a295 tempest-VolumesSnapshotListTestJSON-1878864291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e46d598c-331d-46f0-ab7b-37e22cac8fae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:22:11 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[8361b3fa-3a4a-4fa1-884b-b72ed7f6d127]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d62b62a7-25c0-423f-b8eb-8a0c22b0a295 tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:11 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19 Jul 08 01:22:11 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:12 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7850a20d-7bfc-48bd-ba2b-3d169105a0ab tempest-TestInstancesWithCinderVolumes-269993021 None] Acquiring lock "cinder-83eb3da9-9422-45cb-9620-8baed7a85580-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:12 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7850a20d-7bfc-48bd-ba2b-3d169105a0ab tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "cinder-83eb3da9-9422-45cb-9620-8baed7a85580-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:12 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:12 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7850a20d-7bfc-48bd-ba2b-3d169105a0ab tempest-TestInstancesWithCinderVolumes-269993021 None] Acquiring lock "cinder-quobyte-83eb3da9-9422-45cb-9620-8baed7a85580" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d62b62a7-25c0-423f-b8eb-8a0c22b0a295 tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19" returned: 0 in 0.807s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:12 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-d62b62a7-25c0-423f-b8eb-8a0c22b0a295 tempest-VolumesSnapshotListTestJSON-1878864291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e46d598c-331d-46f0-ab7b-37e22cac8fae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:22:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d62b62a7-25c0-423f-b8eb-8a0c22b0a295 tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.6fc3368a-58ca-455f-b734-f784006268f6 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:12 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7850a20d-7bfc-48bd-ba2b-3d169105a0ab tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "cinder-quobyte-83eb3da9-9422-45cb-9620-8baed7a85580" acquired by "delete_volume" :: waited 0.039s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:12 devstack sudo[101194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.6fc3368a-58ca-455f-b734-f784006268f6 Jul 08 01:22:12 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:12 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fd6086-e422-455a-bc65-520a6816b25b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7850a20d-7bfc-48bd-ba2b-3d169105a0ab tempest-TestInstancesWithCinderVolumes-269993021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83eb3da9-9422-45cb-9620-8baed7a85580 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:12 devstack sudo[101216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83eb3da9-9422-45cb-9620-8baed7a85580 Jul 08 01:22:12 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:12 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Flow 'volume_create_manager' (9f112303-fb83-4d39-894c-8741c553397a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9827809-f202-4f05-a681-d30daf85aae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9827809-f202-4f05-a681-d30daf85aae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-247692609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe64897-79ec-4b90-b046-329517cdee65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fef19ddef1f442093657660791a7532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:22:13Z,use_quota=True,user_id='fcdfefd8d5d8422ea9f85a93f7a2e434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96faf81c-2479-4773-a6aa-ddf5b13979ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96faf81c-2479-4773-a6aa-ddf5b13979ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e45bc1-a2d3-4fc3-8b53-10ad1a3faaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e45bc1-a2d3-4fc3-8b53-10ad1a3faaa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abe64897-79ec-4b90-b046-329517cdee65', 'volume_name': 'volume-abe64897-79ec-4b90-b046-329517cdee65', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a0c17cd-9445-4841-acc8-cea46cd26ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a0c17cd-9445-4841-acc8-cea46cd26ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb1cc0d1-1781-4f7a-a9c4-66f70fd774c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:13 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Volume abe64897-79ec-4b90-b046-329517cdee65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abe64897-79ec-4b90-b046-329517cdee65', 'volume_size': 1} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-247692609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe64897-79ec-4b90-b046-329517cdee65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fef19ddef1f442093657660791a7532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:22:13Z,use_quota=True,user_id='fcdfefd8d5d8422ea9f85a93f7a2e434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Creating volume abe64897-79ec-4b90-b046-329517cdee65 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:22:13 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-abe64897-79ec-4b90-b046-329517cdee65 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:13 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-abe64897-79ec-4b90-b046-329517cdee65 1073741824 Jul 08 01:22:13 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Flow 'volume_create_manager' (faa74793-b073-4915-b23f-b93c8f2f558c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bcf4634-6f2a-4e91-8277-7a4018fc2463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bcf4634-6f2a-4e91-8277-7a4018fc2463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1531998273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a10b44e-4551-4255-b105-a2cd03b59d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fef19ddef1f442093657660791a7532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:22:14Z,use_quota=True,user_id='fcdfefd8d5d8422ea9f85a93f7a2e434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (949a7d3c-e0da-401f-8f9e-e1bb476dc9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (949a7d3c-e0da-401f-8f9e-e1bb476dc9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (745353fa-10ca-46b4-9f94-d44d4b7ab8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (745353fa-10ca-46b4-9f94-d44d4b7ab8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a10b44e-4551-4255-b105-a2cd03b59d05', 'volume_name': 'volume-4a10b44e-4551-4255-b105-a2cd03b59d05', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636aa682-240a-4856-9cac-f569f960356c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636aa682-240a-4856-9cac-f569f960356c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aff9982-957b-43a8-849e-5c04ddcdbbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:13 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Volume 4a10b44e-4551-4255-b105-a2cd03b59d05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a10b44e-4551-4255-b105-a2cd03b59d05', 'volume_size': 1} Jul 08 01:22:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:14 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:22:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Flow 'volume_create_manager' (6da900f1-f95c-46ca-b744-866368ec7ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:22:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55bca2c1-c464-45fd-8f8e-45d220b098c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:14 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55bca2c1-c464-45fd-8f8e-45d220b098c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-642790378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79375774-1f89-4837-a9f0-8f45edf19e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fef19ddef1f442093657660791a7532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:22:14Z,use_quota=True,user_id='fcdfefd8d5d8422ea9f85a93f7a2e434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1201dd5-4212-4b18-9314-8312f0acb9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1201dd5-4212-4b18-9314-8312f0acb9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d2dec0-b77e-49ca-b552-c7962c79dffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d2dec0-b77e-49ca-b552-c7962c79dffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79375774-1f89-4837-a9f0-8f45edf19e63', 'volume_name': 'volume-79375774-1f89-4837-a9f0-8f45edf19e63', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35fddea3-275e-4fd6-806c-22f147a3ce6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35fddea3-275e-4fd6-806c-22f147a3ce6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (890a065d-915c-4eb9-9303-32f249def221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:14 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Volume 79375774-1f89-4837-a9f0-8f45edf19e63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79375774-1f89-4837-a9f0-8f45edf19e63', 'volume_size': 1} Jul 08 01:22:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d62b62a7-25c0-423f-b8eb-8a0c22b0a295 tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.6fc3368a-58ca-455f-b734-f784006268f6" returned: 0 in 1.840s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d62b62a7-25c0-423f-b8eb-8a0c22b0a295 tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.6fc3368a-58ca-455f-b734-f784006268f6 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:14 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.6fc3368a-58ca-455f-b734-f784006268f6 Jul 08 01:22:14 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:14 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7850a20d-7bfc-48bd-ba2b-3d169105a0ab tempest-TestInstancesWithCinderVolumes-269993021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83eb3da9-9422-45cb-9620-8baed7a85580" returned: 0 in 1.926s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7850a20d-7bfc-48bd-ba2b-3d169105a0ab tempest-TestInstancesWithCinderVolumes-269993021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83eb3da9-9422-45cb-9620-8baed7a85580 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:14 devstack sudo[101240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83eb3da9-9422-45cb-9620-8baed7a85580 Jul 08 01:22:14 devstack sudo[101240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:14 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=67,cinder:UPDATE=64,cinder:INSERT=17,cinder:DELETE=3 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:22:14 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=65,cinder:UPDATE=60,cinder:DELETE=9,cinder:INSERT=8 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:22:14 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:22:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Flow 'volume_create_manager' (d142bc99-4ee1-47ad-bdfd-2237f59830d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:22:15 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9e89edc-9be7-4fdc-961f-061f5144a744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-abe64897-79ec-4b90-b046-329517cdee65 1073741824" returned: 0 in 1.768s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9e89edc-9be7-4fdc-961f-061f5144a744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-567448659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74ec6a25-7efd-4786-84d2-61a126c22dd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fef19ddef1f442093657660791a7532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:22:15Z,use_quota=True,user_id='fcdfefd8d5d8422ea9f85a93f7a2e434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c4d5a5c-00af-462a-9675-7f6336eab9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c4d5a5c-00af-462a-9675-7f6336eab9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fdd3a8e-f6ad-49ba-8f65-6e78f2f28f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fdd3a8e-f6ad-49ba-8f65-6e78f2f28f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74ec6a25-7efd-4786-84d2-61a126c22dd2', 'volume_name': 'volume-74ec6a25-7efd-4786-84d2-61a126c22dd2', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2680a679-5e02-4741-8a77-3fd128a32b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2680a679-5e02-4741-8a77-3fd128a32b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e45311-6942-4bdb-a5e4-2831b61c7b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:15 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Volume 74ec6a25-7efd-4786-84d2-61a126c22dd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74ec6a25-7efd-4786-84d2-61a126c22dd2', 'volume_size': 1} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-abe64897-79ec-4b90-b046-329517cdee65 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:15 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-abe64897-79ec-4b90-b046-329517cdee65 Jul 08 01:22:15 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:15 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Flow 'volume_create_manager' (fb1552e7-b0d3-45de-b6f0-62dc4f48a7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4367c80-91f2-486a-b1b1-0e0bfd5aa406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d62b62a7-25c0-423f-b8eb-8a0c22b0a295 tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.6fc3368a-58ca-455f-b734-f784006268f6" returned: 0 in 1.185s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:15 devstack sudo[101240]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7850a20d-7bfc-48bd-ba2b-3d169105a0ab tempest-TestInstancesWithCinderVolumes-269993021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83eb3da9-9422-45cb-9620-8baed7a85580" returned: 0 in 1.077s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d62b62a7-25c0-423f-b8eb-8a0c22b0a295 tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "cinder-quobyte-6fc3368a-58ca-455f-b734-f784006268f6" released by "_delete_snapshot" :: held 4.826s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4367c80-91f2-486a-b1b1-0e0bfd5aa406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1243394650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f73b02ce-cbde-4774-92cf-3740610de66c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fef19ddef1f442093657660791a7532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:22:15Z,use_quota=True,user_id='fcdfefd8d5d8422ea9f85a93f7a2e434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb1c382-e408-4949-bc80-e57fbd39cd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb1c382-e408-4949-bc80-e57fbd39cd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73f5bec-c9ac-4ce8-b42c-1b9363fe5f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73f5bec-c9ac-4ce8-b42c-1b9363fe5f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f73b02ce-cbde-4774-92cf-3740610de66c', 'volume_name': 'volume-f73b02ce-cbde-4774-92cf-3740610de66c', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78171c0-4fe1-4b66-9568-dd86aba995db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78171c0-4fe1-4b66-9568-dd86aba995db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd43a7c-9537-496b-98fc-2d4179391785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:15 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Volume f73b02ce-cbde-4774-92cf-3740610de66c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f73b02ce-cbde-4774-92cf-3740610de66c', 'volume_size': 1} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d62b62a7-25c0-423f-b8eb-8a0c22b0a295 tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "cinder-quobyte-e46d598c-331d-46f0-ab7b-37e22cac8fae" released by "delete_snapshot" :: held 4.928s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7850a20d-7bfc-48bd-ba2b-3d169105a0ab tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "cinder-quobyte-83eb3da9-9422-45cb-9620-8baed7a85580" released by "delete_volume" :: held 3.188s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:15 devstack cinder-volume[87022]: WARNING cinder.quota [None req-7850a20d-7bfc-48bd-ba2b-3d169105a0ab tempest-TestInstancesWithCinderVolumes-269993021 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1795218054-840870010 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1795218054-840870010, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:22:15 devstack cinder-volume[87022]: WARNING cinder.quota [None req-7850a20d-7bfc-48bd-ba2b-3d169105a0ab tempest-TestInstancesWithCinderVolumes-269993021 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1795218054-840870010 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1795218054-840870010, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-d62b62a7-25c0-423f-b8eb-8a0c22b0a295 tempest-VolumesSnapshotListTestJSON-1878864291 None] Created reservations ['4effcdad-4fde-4a03-9e1f-b548279b3f14', '5ab6a0fa-c89e-457c-ad87-0dfdd49ff263', 'be00f3bf-7a6d-41d5-90e2-67b3c52e52e7', 'dd9340f4-aeb9-471a-b266-f947d4ae8815'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-7850a20d-7bfc-48bd-ba2b-3d169105a0ab tempest-TestInstancesWithCinderVolumes-269993021 None] Created reservations ['1b959386-fa5f-4f92-ae0e-262ef6b0dc5c', '787e7cc0-5f52-4bf3-b631-3008e388b4df', 'abfc90fd-1a43-4b07-85a9-ca18141ddf88', '2946aa97-f686-4328-a108-a6db8b509aaf'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:22:15 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-d62b62a7-25c0-423f-b8eb-8a0c22b0a295 tempest-VolumesSnapshotListTestJSON-1878864291 None] Delete snapshot completed successfully. Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d62b62a7-25c0-423f-b8eb-8a0c22b0a295 tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "cinder-6fc3368a-58ca-455f-b734-f784006268f6-delete_snapshot" released by "delete_snapshot" :: held 5.164s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7850a20d-7bfc-48bd-ba2b-3d169105a0ab tempest-TestInstancesWithCinderVolumes-269993021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7850a20d-7bfc-48bd-ba2b-3d169105a0ab tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7850a20d-7bfc-48bd-ba2b-3d169105a0ab tempest-TestInstancesWithCinderVolumes-269993021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7850a20d-7bfc-48bd-ba2b-3d169105a0ab tempest-TestInstancesWithCinderVolumes-269993021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7850a20d-7bfc-48bd-ba2b-3d169105a0ab tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7850a20d-7bfc-48bd-ba2b-3d169105a0ab tempest-TestInstancesWithCinderVolumes-269993021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:16 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:22:16 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:16 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-abe64897-79ec-4b90-b046-329517cdee65" returned: 0 in 0.875s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] <== create_volume: return (2799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.803s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.087s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1531998273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a10b44e-4551-4255-b105-a2cd03b59d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fef19ddef1f442093657660791a7532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:22:14Z,use_quota=True,user_id='fcdfefd8d5d8422ea9f85a93f7a2e434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Creating volume 4a10b44e-4551-4255-b105-a2cd03b59d05 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:22:16 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4a10b44e-4551-4255-b105-a2cd03b59d05 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:16 devstack sudo[101263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4a10b44e-4551-4255-b105-a2cd03b59d05 1073741824 Jul 08 01:22:16 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb1cc0d1-1781-4f7a-a9c4-66f70fd774c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abe64897-79ec-4b90-b046-329517cdee65', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fcc8ae5-e029-4e6d-8cf3-9fce90d35ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:16 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Volume volume-abe64897-79ec-4b90-b046-329517cdee65 (abe64897-79ec-4b90-b046-329517cdee65): created successfully Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fcc8ae5-e029-4e6d-8cf3-9fce90d35ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Flow 'volume_create_manager' (9f112303-fb83-4d39-894c-8741c553397a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a3a2a392-0410-4df7-8ddf-675fc12760ea tempest-VolumesSnapshotListTestJSON-1878864291 None] Acquiring lock "cinder-acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:16 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-f99dc02d-3ee5-48d7-ba4e-9a7fdd9c7c98 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Created volume successfully. Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a3a2a392-0410-4df7-8ddf-675fc12760ea tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "cinder-acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a3a2a392-0410-4df7-8ddf-675fc12760ea tempest-VolumesSnapshotListTestJSON-1878864291 None] Acquiring lock "cinder-quobyte-e46d598c-331d-46f0-ab7b-37e22cac8fae" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a3a2a392-0410-4df7-8ddf-675fc12760ea tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "cinder-quobyte-e46d598c-331d-46f0-ab7b-37e22cac8fae" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a3a2a392-0410-4df7-8ddf-675fc12760ea tempest-VolumesSnapshotListTestJSON-1878864291 None] Acquiring lock "cinder-quobyte-acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a3a2a392-0410-4df7-8ddf-675fc12760ea tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "cinder-quobyte-acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-a3a2a392-0410-4df7-8ddf-675fc12760ea tempest-VolumesSnapshotListTestJSON-1878864291 None] Deleting offline snapshot acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19 of volume e46d598c-331d-46f0-ab7b-37e22cac8fae {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-a3a2a392-0410-4df7-8ddf-675fc12760ea tempest-VolumesSnapshotListTestJSON-1878864291 None] snapshot_file for this snap is: volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b233083c-3444-4b79-99f5-0ffae5dd2038]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a3a2a392-0410-4df7-8ddf-675fc12760ea tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:16 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19 Jul 08 01:22:16 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-834ea585-f0c6-4ad3-b1f7-0fe90b64e6b8 req-fae4a27d-811a-4dae-83f2-9ff62a337ecf tempest-TestStampPattern-1012369784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:16 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7850a20d-7bfc-48bd-ba2b-3d169105a0ab tempest-TestInstancesWithCinderVolumes-269993021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.852s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-7850a20d-7bfc-48bd-ba2b-3d169105a0ab tempest-TestInstancesWithCinderVolumes-269993021 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:22:16 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-7850a20d-7bfc-48bd-ba2b-3d169105a0ab tempest-TestInstancesWithCinderVolumes-269993021 None] Deleted volume successfully. Jul 08 01:22:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7850a20d-7bfc-48bd-ba2b-3d169105a0ab tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "cinder-83eb3da9-9422-45cb-9620-8baed7a85580-delete_volume" released by "delete_volume" :: held 4.412s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:17 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4a10b44e-4551-4255-b105-a2cd03b59d05 1073741824" returned: 0 in 1.287s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:17 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a3a2a392-0410-4df7-8ddf-675fc12760ea tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19" returned: 0 in 0.998s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-a3a2a392-0410-4df7-8ddf-675fc12760ea tempest-VolumesSnapshotListTestJSON-1878864291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e46d598c-331d-46f0-ab7b-37e22cac8fae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:22:17 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7a5880-04f5-4df4-83f8-8300f250cef4]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a3a2a392-0410-4df7-8ddf-675fc12760ea tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4a10b44e-4551-4255-b105-a2cd03b59d05 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:17 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4a10b44e-4551-4255-b105-a2cd03b59d05 Jul 08 01:22:17 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:17 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a Jul 08 01:22:17 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:18 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4a10b44e-4551-4255-b105-a2cd03b59d05" returned: 0 in 0.652s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:22:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.695s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-642790378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79375774-1f89-4837-a9f0-8f45edf19e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fef19ddef1f442093657660791a7532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:22:14Z,use_quota=True,user_id='fcdfefd8d5d8422ea9f85a93f7a2e434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:22:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Creating volume 79375774-1f89-4837-a9f0-8f45edf19e63 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:22:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:22:18 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:22:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-79375774-1f89-4837-a9f0-8f45edf19e63 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:18 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-79375774-1f89-4837-a9f0-8f45edf19e63 1073741824 Jul 08 01:22:18 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aff9982-957b-43a8-849e-5c04ddcdbbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a10b44e-4551-4255-b105-a2cd03b59d05', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92438648-1f60-4f59-8dd3-ea811ba275c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:18 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Volume volume-4a10b44e-4551-4255-b105-a2cd03b59d05 (4a10b44e-4551-4255-b105-a2cd03b59d05): created successfully Jul 08 01:22:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92438648-1f60-4f59-8dd3-ea811ba275c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Flow 'volume_create_manager' (faa74793-b073-4915-b23f-b93c8f2f558c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:22:18 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-bdacb77f-5d9d-4692-9860-e53d1fc3239c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Created volume successfully. Jul 08 01:22:18 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a3a2a392-0410-4df7-8ddf-675fc12760ea tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a" returned: 0 in 0.848s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-a3a2a392-0410-4df7-8ddf-675fc12760ea tempest-VolumesSnapshotListTestJSON-1878864291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e46d598c-331d-46f0-ab7b-37e22cac8fae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:22:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a3a2a392-0410-4df7-8ddf-675fc12760ea tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:18 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19 Jul 08 01:22:18 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:18 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-7fb08d89-a603-43ca-898e-b7546ab50d60 req-c0189b4e-ea37-4265-ab33-6a934df3336a tempest-TestInstancesWithCinderVolumes-269993021 None] Terminate volume connection completed successfully. Jul 08 01:22:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-7fb08d89-a603-43ca-898e-b7546ab50d60 req-c0189b4e-ea37-4265-ab33-6a934df3336a tempest-TestInstancesWithCinderVolumes-269993021 None] Deleting attachment 1162955c-ab8e-4bf8-a82e-82d2a5a581df. {{(pid=87022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:22:18 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-79375774-1f89-4837-a9f0-8f45edf19e63 1073741824" returned: 0 in 0.890s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-79375774-1f89-4837-a9f0-8f45edf19e63 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:19 devstack sudo[101316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-79375774-1f89-4837-a9f0-8f45edf19e63 Jul 08 01:22:19 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:19 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a3a2a392-0410-4df7-8ddf-675fc12760ea tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19" returned: 0 in 0.840s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a3a2a392-0410-4df7-8ddf-675fc12760ea tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:19 devstack sudo[101318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19 Jul 08 01:22:19 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:19 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-79375774-1f89-4837-a9f0-8f45edf19e63" returned: 0 in 0.677s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:22:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.567s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-567448659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74ec6a25-7efd-4786-84d2-61a126c22dd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fef19ddef1f442093657660791a7532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:22:15Z,use_quota=True,user_id='fcdfefd8d5d8422ea9f85a93f7a2e434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:22:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Creating volume 74ec6a25-7efd-4786-84d2-61a126c22dd2 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:22:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:22:19 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:22:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-74ec6a25-7efd-4786-84d2-61a126c22dd2 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (890a065d-915c-4eb9-9303-32f249def221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79375774-1f89-4837-a9f0-8f45edf19e63', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:19 devstack sudo[101322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-74ec6a25-7efd-4786-84d2-61a126c22dd2 1073741824 Jul 08 01:22:19 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f89257-75a7-4e52-949c-fac5a70c4bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:19 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Volume volume-79375774-1f89-4837-a9f0-8f45edf19e63 (79375774-1f89-4837-a9f0-8f45edf19e63): created successfully Jul 08 01:22:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f89257-75a7-4e52-949c-fac5a70c4bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Flow 'volume_create_manager' (6da900f1-f95c-46ca-b744-866368ec7ba7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:22:19 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-af6de75c-b92f-4ce9-ba9a-fd7261966c13 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Created volume successfully. Jul 08 01:22:19 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a3a2a392-0410-4df7-8ddf-675fc12760ea tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19" returned: 0 in 0.736s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a3a2a392-0410-4df7-8ddf-675fc12760ea tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "cinder-quobyte-acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19" released by "_delete_snapshot" :: held 3.559s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a3a2a392-0410-4df7-8ddf-675fc12760ea tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "cinder-quobyte-e46d598c-331d-46f0-ab7b-37e22cac8fae" released by "delete_snapshot" :: held 3.586s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:19 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-a3a2a392-0410-4df7-8ddf-675fc12760ea tempest-VolumesSnapshotListTestJSON-1878864291 None] Created reservations ['d1eb21a0-5d3b-4631-93e4-48f96501b908', '27c89c4a-1717-45d1-ad4b-ecc6446a84e2', 'e8258043-82a3-4ea9-97bf-6b5cefe58a17', 'e273de70-8953-4bbc-a40e-ab1f77042131'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:22:19 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-a3a2a392-0410-4df7-8ddf-675fc12760ea tempest-VolumesSnapshotListTestJSON-1878864291 None] Delete snapshot completed successfully. Jul 08 01:22:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a3a2a392-0410-4df7-8ddf-675fc12760ea tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "cinder-acbd0e3f-62c6-42d3-a3a0-21a0a1e5cc19-delete_snapshot" released by "delete_snapshot" :: held 3.723s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e3908d02-67ff-497d-8abf-bc9d5f0319ce tempest-VolumesSnapshotListTestJSON-1878864291 None] Acquiring lock "cinder-13a5e3c8-5ef7-41e7-9fef-0765b905030a-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e3908d02-67ff-497d-8abf-bc9d5f0319ce tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "cinder-13a5e3c8-5ef7-41e7-9fef-0765b905030a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e3908d02-67ff-497d-8abf-bc9d5f0319ce tempest-VolumesSnapshotListTestJSON-1878864291 None] Acquiring lock "cinder-quobyte-e46d598c-331d-46f0-ab7b-37e22cac8fae" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e3908d02-67ff-497d-8abf-bc9d5f0319ce tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "cinder-quobyte-e46d598c-331d-46f0-ab7b-37e22cac8fae" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e3908d02-67ff-497d-8abf-bc9d5f0319ce tempest-VolumesSnapshotListTestJSON-1878864291 None] Acquiring lock "cinder-quobyte-13a5e3c8-5ef7-41e7-9fef-0765b905030a" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e3908d02-67ff-497d-8abf-bc9d5f0319ce tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "cinder-quobyte-13a5e3c8-5ef7-41e7-9fef-0765b905030a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:20 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-e3908d02-67ff-497d-8abf-bc9d5f0319ce tempest-VolumesSnapshotListTestJSON-1878864291 None] Deleting offline snapshot 13a5e3c8-5ef7-41e7-9fef-0765b905030a of volume e46d598c-331d-46f0-ab7b-37e22cac8fae {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:22:20 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-e3908d02-67ff-497d-8abf-bc9d5f0319ce tempest-VolumesSnapshotListTestJSON-1878864291 None] snapshot_file for this snap is: volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:22:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5e9ea5e7-63a7-4478-ad27-86a1201e78d3 tempest-TestInstancesWithCinderVolumes-269993021 None] Acquiring lock "cinder-83805664-bb82-4422-bbb0-413edd8964ca-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:20 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd6add3-a955-472d-9123-933758b6a6a9]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3908d02-67ff-497d-8abf-bc9d5f0319ce tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5e9ea5e7-63a7-4478-ad27-86a1201e78d3 tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "cinder-83805664-bb82-4422-bbb0-413edd8964ca-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:20 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-74ec6a25-7efd-4786-84d2-61a126c22dd2 1073741824" returned: 0 in 0.960s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5e9ea5e7-63a7-4478-ad27-86a1201e78d3 tempest-TestInstancesWithCinderVolumes-269993021 None] Acquiring lock "cinder-quobyte-83805664-bb82-4422-bbb0-413edd8964ca" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-74ec6a25-7efd-4786-84d2-61a126c22dd2 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5e9ea5e7-63a7-4478-ad27-86a1201e78d3 tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "cinder-quobyte-83805664-bb82-4422-bbb0-413edd8964ca" acquired by "delete_volume" :: waited 0.046s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:20 devstack sudo[101330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-74ec6a25-7efd-4786-84d2-61a126c22dd2 Jul 08 01:22:20 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:20 devstack sudo[101329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a Jul 08 01:22:20 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:20 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[6708968a-b3db-4536-8341-dac120e7a79b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5e9ea5e7-63a7-4478-ad27-86a1201e78d3 tempest-TestInstancesWithCinderVolumes-269993021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83805664-bb82-4422-bbb0-413edd8964ca {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:20 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83805664-bb82-4422-bbb0-413edd8964ca Jul 08 01:22:20 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:21 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-74ec6a25-7efd-4786-84d2-61a126c22dd2" returned: 0 in 0.758s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:22:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.777s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1243394650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f73b02ce-cbde-4774-92cf-3740610de66c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fef19ddef1f442093657660791a7532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:22:15Z,use_quota=True,user_id='fcdfefd8d5d8422ea9f85a93f7a2e434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:22:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Creating volume f73b02ce-cbde-4774-92cf-3740610de66c {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:22:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:22:21 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:22:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f73b02ce-cbde-4774-92cf-3740610de66c 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e45311-6942-4bdb-a5e4-2831b61c7b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74ec6a25-7efd-4786-84d2-61a126c22dd2', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af57616-8b4b-4e1e-9bcc-6869a5af896a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:21 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f73b02ce-cbde-4774-92cf-3740610de66c 1073741824 Jul 08 01:22:21 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:21 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Volume volume-74ec6a25-7efd-4786-84d2-61a126c22dd2 (74ec6a25-7efd-4786-84d2-61a126c22dd2): created successfully Jul 08 01:22:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af57616-8b4b-4e1e-9bcc-6869a5af896a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Flow 'volume_create_manager' (d142bc99-4ee1-47ad-bdfd-2237f59830d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:22:21 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-1c5c32ee-59b7-480a-8435-f9498b2d6fcf tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Created volume successfully. Jul 08 01:22:21 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3908d02-67ff-497d-8abf-bc9d5f0319ce tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a" returned: 0 in 1.040s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-e3908d02-67ff-497d-8abf-bc9d5f0319ce tempest-VolumesSnapshotListTestJSON-1878864291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e46d598c-331d-46f0-ab7b-37e22cac8fae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:22:21 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c008da-204d-4a3e-b0df-c90d146bf0c6]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3908d02-67ff-497d-8abf-bc9d5f0319ce tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:21 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5e9ea5e7-63a7-4478-ad27-86a1201e78d3 tempest-TestInstancesWithCinderVolumes-269993021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83805664-bb82-4422-bbb0-413edd8964ca" returned: 0 in 0.939s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5e9ea5e7-63a7-4478-ad27-86a1201e78d3 tempest-TestInstancesWithCinderVolumes-269993021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83805664-bb82-4422-bbb0-413edd8964ca {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:21 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83805664-bb82-4422-bbb0-413edd8964ca Jul 08 01:22:21 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:21 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae Jul 08 01:22:21 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:22 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5e9ea5e7-63a7-4478-ad27-86a1201e78d3 tempest-TestInstancesWithCinderVolumes-269993021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-83805664-bb82-4422-bbb0-413edd8964ca" returned: 0 in 0.821s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5e9ea5e7-63a7-4478-ad27-86a1201e78d3 tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "cinder-quobyte-83805664-bb82-4422-bbb0-413edd8964ca" released by "delete_volume" :: held 1.832s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:22 devstack cinder-volume[87022]: WARNING cinder.quota [None req-5e9ea5e7-63a7-4478-ad27-86a1201e78d3 tempest-TestInstancesWithCinderVolumes-269993021 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1149709979-1235072349 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1149709979-1235072349, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:22:22 devstack cinder-volume[87022]: WARNING cinder.quota [None req-5e9ea5e7-63a7-4478-ad27-86a1201e78d3 tempest-TestInstancesWithCinderVolumes-269993021 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1149709979-1235072349 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1149709979-1235072349, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:22:22 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3908d02-67ff-497d-8abf-bc9d5f0319ce tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae" returned: 0 in 0.961s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3908d02-67ff-497d-8abf-bc9d5f0319ce tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:22 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f73b02ce-cbde-4774-92cf-3740610de66c 1073741824" returned: 0 in 1.174s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:22 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a Jul 08 01:22:22 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:22 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-5e9ea5e7-63a7-4478-ad27-86a1201e78d3 tempest-TestInstancesWithCinderVolumes-269993021 None] Created reservations ['b880368f-eac4-4724-a2bb-7ba4f8f05e22', '3633a57e-b137-4e06-8e1f-eb5460309012', 'a61f8875-1d98-4a05-830a-71660a47e837', '49e413cf-fd14-4004-9a31-98b072a5f37a'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:22:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f73b02ce-cbde-4774-92cf-3740610de66c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:22 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f73b02ce-cbde-4774-92cf-3740610de66c Jul 08 01:22:22 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5e9ea5e7-63a7-4478-ad27-86a1201e78d3 tempest-TestInstancesWithCinderVolumes-269993021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5e9ea5e7-63a7-4478-ad27-86a1201e78d3 tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:22 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5e9ea5e7-63a7-4478-ad27-86a1201e78d3 tempest-TestInstancesWithCinderVolumes-269993021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:22 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5e9ea5e7-63a7-4478-ad27-86a1201e78d3 tempest-TestInstancesWithCinderVolumes-269993021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5e9ea5e7-63a7-4478-ad27-86a1201e78d3 tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5e9ea5e7-63a7-4478-ad27-86a1201e78d3 tempest-TestInstancesWithCinderVolumes-269993021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:22 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:22:22 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:23 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f73b02ce-cbde-4774-92cf-3740610de66c" returned: 0 in 0.958s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] <== create_volume: return (2245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:22:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.252s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-834ea585-f0c6-4ad3-b1f7-0fe90b64e6b8 req-fae4a27d-811a-4dae-83f2-9ff62a337ecf tempest-TestStampPattern-1012369784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.025s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd43a7c-9537-496b-98fc-2d4179391785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f73b02ce-cbde-4774-92cf-3740610de66c', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:23 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7990bf6-ef76-4b4d-b417-d2fb7a89d510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:23 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81535b7-6c2f-4839-b9ea-b30c4807f464]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-834ea585-f0c6-4ad3-b1f7-0fe90b64e6b8 req-fae4a27d-811a-4dae-83f2-9ff62a337ecf tempest-TestStampPattern-1012369784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5e9ea5e7-63a7-4478-ad27-86a1201e78d3 tempest-TestInstancesWithCinderVolumes-269993021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.965s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:23 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-5e9ea5e7-63a7-4478-ad27-86a1201e78d3 tempest-TestInstancesWithCinderVolumes-269993021 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:22:23 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-5e9ea5e7-63a7-4478-ad27-86a1201e78d3 tempest-TestInstancesWithCinderVolumes-269993021 None] Deleted volume successfully. Jul 08 01:22:23 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Volume volume-f73b02ce-cbde-4774-92cf-3740610de66c (f73b02ce-cbde-4774-92cf-3740610de66c): created successfully Jul 08 01:22:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7990bf6-ef76-4b4d-b417-d2fb7a89d510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Flow 'volume_create_manager' (fb1552e7-b0d3-45de-b6f0-62dc4f48a7a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:22:23 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5e9ea5e7-63a7-4478-ad27-86a1201e78d3 tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "cinder-83805664-bb82-4422-bbb0-413edd8964ca-delete_volume" released by "delete_volume" :: held 3.254s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:23 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-01c4d95c-0a3f-4bb4-b1ce-9aee9795c101 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Created volume successfully. Jul 08 01:22:23 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c Jul 08 01:22:23 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:24 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3908d02-67ff-497d-8abf-bc9d5f0319ce tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a" returned: 0 in 1.344s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3908d02-67ff-497d-8abf-bc9d5f0319ce tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:24 devstack sudo[101374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a Jul 08 01:22:24 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:24 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3908d02-67ff-497d-8abf-bc9d5f0319ce tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae.13a5e3c8-5ef7-41e7-9fef-0765b905030a" returned: 0 in 0.717s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:24 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-834ea585-f0c6-4ad3-b1f7-0fe90b64e6b8 req-fae4a27d-811a-4dae-83f2-9ff62a337ecf tempest-TestStampPattern-1012369784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c" returned: 0 in 0.972s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-834ea585-f0c6-4ad3-b1f7-0fe90b64e6b8 req-fae4a27d-811a-4dae-83f2-9ff62a337ecf tempest-TestStampPattern-1012369784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.022s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e3908d02-67ff-497d-8abf-bc9d5f0319ce tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "cinder-quobyte-13a5e3c8-5ef7-41e7-9fef-0765b905030a" released by "_delete_snapshot" :: held 4.223s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e3908d02-67ff-497d-8abf-bc9d5f0319ce tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "cinder-quobyte-e46d598c-331d-46f0-ab7b-37e22cac8fae" released by "delete_snapshot" :: held 4.256s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-834ea585-f0c6-4ad3-b1f7-0fe90b64e6b8 req-fae4a27d-811a-4dae-83f2-9ff62a337ecf tempest-TestStampPattern-1012369784 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d', 'name': 'volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9cd3221-bcd6-44d2-8a97-835839525986', 'enforce_multipath': True} {{(pid=87022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:22:24 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-834ea585-f0c6-4ad3-b1f7-0fe90b64e6b8 req-fae4a27d-811a-4dae-83f2-9ff62a337ecf tempest-TestStampPattern-1012369784 None] attachment_update completed successfully. Jul 08 01:22:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-36c98b72-17dc-464e-b463-f4253f3a949f tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "cinder-f73b02ce-cbde-4774-92cf-3740610de66c-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:24 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-e3908d02-67ff-497d-8abf-bc9d5f0319ce tempest-VolumesSnapshotListTestJSON-1878864291 None] Created reservations ['4ae3bc44-e09e-4777-8e5d-45a0cd357f07', '27b351cd-b5ae-4da2-9f6f-4bad3ca923cb', '70918a75-e634-4900-8959-a0936466b872', '0fadb3dc-1e6a-4213-914a-a72e10a70054'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:22:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-36c98b72-17dc-464e-b463-f4253f3a949f tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "cinder-f73b02ce-cbde-4774-92cf-3740610de66c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-36c98b72-17dc-464e-b463-f4253f3a949f tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "cinder-quobyte-f73b02ce-cbde-4774-92cf-3740610de66c" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-36c98b72-17dc-464e-b463-f4253f3a949f tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "cinder-quobyte-f73b02ce-cbde-4774-92cf-3740610de66c" acquired by "delete_volume" :: waited 0.025s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:25 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-e3908d02-67ff-497d-8abf-bc9d5f0319ce tempest-VolumesSnapshotListTestJSON-1878864291 None] Delete snapshot completed successfully. Jul 08 01:22:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e3908d02-67ff-497d-8abf-bc9d5f0319ce tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "cinder-13a5e3c8-5ef7-41e7-9fef-0765b905030a-delete_snapshot" released by "delete_snapshot" :: held 4.538s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:25 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c148c59a-8b2c-4b9e-937b-0054707b2964]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-36c98b72-17dc-464e-b463-f4253f3a949f tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f73b02ce-cbde-4774-92cf-3740610de66c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8344d66a-7f2e-436c-8729-0f2cd2fd2ebd tempest-VolumesSnapshotListTestJSON-1878864291 None] Acquiring lock "cinder-e46d598c-331d-46f0-ab7b-37e22cac8fae-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:25 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f73b02ce-cbde-4774-92cf-3740610de66c Jul 08 01:22:25 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8344d66a-7f2e-436c-8729-0f2cd2fd2ebd tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "cinder-e46d598c-331d-46f0-ab7b-37e22cac8fae-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8344d66a-7f2e-436c-8729-0f2cd2fd2ebd tempest-VolumesSnapshotListTestJSON-1878864291 None] Acquiring lock "cinder-quobyte-e46d598c-331d-46f0-ab7b-37e22cac8fae" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8344d66a-7f2e-436c-8729-0f2cd2fd2ebd tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "cinder-quobyte-e46d598c-331d-46f0-ab7b-37e22cac8fae" acquired by "delete_volume" :: waited 0.018s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:25 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03aafda-3a83-4e02-8085-ab346bcf9714]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8344d66a-7f2e-436c-8729-0f2cd2fd2ebd tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:25 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae Jul 08 01:22:25 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:26 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-36c98b72-17dc-464e-b463-f4253f3a949f tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f73b02ce-cbde-4774-92cf-3740610de66c" returned: 0 in 1.143s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-36c98b72-17dc-464e-b463-f4253f3a949f tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f73b02ce-cbde-4774-92cf-3740610de66c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:26 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f73b02ce-cbde-4774-92cf-3740610de66c Jul 08 01:22:26 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:26 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8344d66a-7f2e-436c-8729-0f2cd2fd2ebd tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae" returned: 0 in 1.191s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8344d66a-7f2e-436c-8729-0f2cd2fd2ebd tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:26 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae Jul 08 01:22:26 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:26 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-36c98b72-17dc-464e-b463-f4253f3a949f tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f73b02ce-cbde-4774-92cf-3740610de66c" returned: 0 in 0.776s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-36c98b72-17dc-464e-b463-f4253f3a949f tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "cinder-quobyte-f73b02ce-cbde-4774-92cf-3740610de66c" released by "delete_volume" :: held 1.977s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:27 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-36c98b72-17dc-464e-b463-f4253f3a949f tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Created reservations ['d1f7662d-bcb1-4e66-9a6f-c0a8ebe93bff', '246808d9-c3f3-4445-ae28-f698d07330ae', '594fc2cb-b3c1-411b-ad52-1b09448110d1', '839f268d-e1b4-4cd5-b7be-5665970edb76'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:22:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-36c98b72-17dc-464e-b463-f4253f3a949f tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-36c98b72-17dc-464e-b463-f4253f3a949f tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-36c98b72-17dc-464e-b463-f4253f3a949f tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-36c98b72-17dc-464e-b463-f4253f3a949f tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-36c98b72-17dc-464e-b463-f4253f3a949f tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-36c98b72-17dc-464e-b463-f4253f3a949f tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:27 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:22:27 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:27 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c9cb4ab1-7813-4c81-bbfe-442b6ac3486c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "cinder-74ec6a25-7efd-4786-84d2-61a126c22dd2-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8344d66a-7f2e-436c-8729-0f2cd2fd2ebd tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e46d598c-331d-46f0-ab7b-37e22cac8fae" returned: 0 in 0.847s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8344d66a-7f2e-436c-8729-0f2cd2fd2ebd tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "cinder-quobyte-e46d598c-331d-46f0-ab7b-37e22cac8fae" released by "delete_volume" :: held 2.126s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c9cb4ab1-7813-4c81-bbfe-442b6ac3486c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "cinder-74ec6a25-7efd-4786-84d2-61a126c22dd2-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c9cb4ab1-7813-4c81-bbfe-442b6ac3486c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "cinder-quobyte-74ec6a25-7efd-4786-84d2-61a126c22dd2" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c9cb4ab1-7813-4c81-bbfe-442b6ac3486c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "cinder-quobyte-74ec6a25-7efd-4786-84d2-61a126c22dd2" acquired by "delete_volume" :: waited 0.035s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:27 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-8344d66a-7f2e-436c-8729-0f2cd2fd2ebd tempest-VolumesSnapshotListTestJSON-1878864291 None] Created reservations ['a5e4a941-df93-4962-ad8a-9ed5a229a0cd', '5c23a5eb-3262-49c9-ae67-095476b9696a', '905e8b90-997c-40d8-96ff-0f7093b270b9', 'bad40e40-61ff-43b8-a6de-0340ef0858d6'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:22:27 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1af7623-d7f7-49db-b6b5-69450ffc15bf]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c9cb4ab1-7813-4c81-bbfe-442b6ac3486c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-74ec6a25-7efd-4786-84d2-61a126c22dd2 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8344d66a-7f2e-436c-8729-0f2cd2fd2ebd tempest-VolumesSnapshotListTestJSON-1878864291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8344d66a-7f2e-436c-8729-0f2cd2fd2ebd tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8344d66a-7f2e-436c-8729-0f2cd2fd2ebd tempest-VolumesSnapshotListTestJSON-1878864291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8344d66a-7f2e-436c-8729-0f2cd2fd2ebd tempest-VolumesSnapshotListTestJSON-1878864291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8344d66a-7f2e-436c-8729-0f2cd2fd2ebd tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8344d66a-7f2e-436c-8729-0f2cd2fd2ebd tempest-VolumesSnapshotListTestJSON-1878864291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:27 devstack sudo[101429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:22:27 devstack sudo[101429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:27 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-74ec6a25-7efd-4786-84d2-61a126c22dd2 Jul 08 01:22:27 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:28 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-36c98b72-17dc-464e-b463-f4253f3a949f tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.911s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:28 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-36c98b72-17dc-464e-b463-f4253f3a949f tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:22:28 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-36c98b72-17dc-464e-b463-f4253f3a949f tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Deleted volume successfully. Jul 08 01:22:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-36c98b72-17dc-464e-b463-f4253f3a949f tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "cinder-f73b02ce-cbde-4774-92cf-3740610de66c-delete_volume" released by "delete_volume" :: held 3.180s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:28 devstack sudo[101429]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8344d66a-7f2e-436c-8729-0f2cd2fd2ebd tempest-VolumesSnapshotListTestJSON-1878864291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.748s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:28 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-8344d66a-7f2e-436c-8729-0f2cd2fd2ebd tempest-VolumesSnapshotListTestJSON-1878864291 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:22:28 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-8344d66a-7f2e-436c-8729-0f2cd2fd2ebd tempest-VolumesSnapshotListTestJSON-1878864291 None] Deleted volume successfully. Jul 08 01:22:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8344d66a-7f2e-436c-8729-0f2cd2fd2ebd tempest-VolumesSnapshotListTestJSON-1878864291 None] Lock "cinder-e46d598c-331d-46f0-ab7b-37e22cac8fae-delete_volume" released by "delete_volume" :: held 3.222s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:28 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c9cb4ab1-7813-4c81-bbfe-442b6ac3486c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-74ec6a25-7efd-4786-84d2-61a126c22dd2" returned: 0 in 0.890s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c9cb4ab1-7813-4c81-bbfe-442b6ac3486c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-74ec6a25-7efd-4786-84d2-61a126c22dd2 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:28 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-74ec6a25-7efd-4786-84d2-61a126c22dd2 Jul 08 01:22:28 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:28 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-639cc713-042a-420e-b6f7-c347123529e9 req-9cbf9ddf-e91c-4909-95e7-48726a51aa4b tempest-TestInstancesWithCinderVolumes-269993021 None] Terminate volume connection completed successfully. Jul 08 01:22:28 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-639cc713-042a-420e-b6f7-c347123529e9 req-9cbf9ddf-e91c-4909-95e7-48726a51aa4b tempest-TestInstancesWithCinderVolumes-269993021 None] Deleting attachment 20dcdf6f-cb1d-490d-ae14-df45b53ddad1. {{(pid=87022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:22:29 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c9cb4ab1-7813-4c81-bbfe-442b6ac3486c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-74ec6a25-7efd-4786-84d2-61a126c22dd2" returned: 0 in 0.701s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:29 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c9cb4ab1-7813-4c81-bbfe-442b6ac3486c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "cinder-quobyte-74ec6a25-7efd-4786-84d2-61a126c22dd2" released by "delete_volume" :: held 1.663s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:29 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-c9cb4ab1-7813-4c81-bbfe-442b6ac3486c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Created reservations ['901c89e3-be4c-458c-b91d-4823155b7435', 'def2fc4a-cd25-485c-9432-262eae802985', 'c86c2a6d-c5cd-4b08-9a30-d1e3f1294813', '9e9f0407-8d5e-4cf0-af43-a9b0b9a877e5'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:22:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c9cb4ab1-7813-4c81-bbfe-442b6ac3486c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c9cb4ab1-7813-4c81-bbfe-442b6ac3486c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c9cb4ab1-7813-4c81-bbfe-442b6ac3486c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c9cb4ab1-7813-4c81-bbfe-442b6ac3486c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c9cb4ab1-7813-4c81-bbfe-442b6ac3486c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c9cb4ab1-7813-4c81-bbfe-442b6ac3486c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:29 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:22:29 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:29 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3b5f9cc2-1ab8-4f29-b977-5abdf0dd3e31 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "cinder-79375774-1f89-4837-a9f0-8f45edf19e63-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:29 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3b5f9cc2-1ab8-4f29-b977-5abdf0dd3e31 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "cinder-79375774-1f89-4837-a9f0-8f45edf19e63-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:29 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3b5f9cc2-1ab8-4f29-b977-5abdf0dd3e31 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "cinder-quobyte-79375774-1f89-4837-a9f0-8f45edf19e63" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:29 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3b5f9cc2-1ab8-4f29-b977-5abdf0dd3e31 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "cinder-quobyte-79375774-1f89-4837-a9f0-8f45edf19e63" acquired by "delete_volume" :: waited 0.018s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:29 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f37bf3c-0bc5-4269-be4d-76be74123e19]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3b5f9cc2-1ab8-4f29-b977-5abdf0dd3e31 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-79375774-1f89-4837-a9f0-8f45edf19e63 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:29 devstack sudo[101448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-79375774-1f89-4837-a9f0-8f45edf19e63 Jul 08 01:22:29 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:30 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c9cb4ab1-7813-4c81-bbfe-442b6ac3486c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.837s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:30 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-c9cb4ab1-7813-4c81-bbfe-442b6ac3486c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:22:30 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-c9cb4ab1-7813-4c81-bbfe-442b6ac3486c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Deleted volume successfully. Jul 08 01:22:30 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c9cb4ab1-7813-4c81-bbfe-442b6ac3486c tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "cinder-74ec6a25-7efd-4786-84d2-61a126c22dd2-delete_volume" released by "delete_volume" :: held 2.958s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:30 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3b5f9cc2-1ab8-4f29-b977-5abdf0dd3e31 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-79375774-1f89-4837-a9f0-8f45edf19e63" returned: 0 in 0.985s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3b5f9cc2-1ab8-4f29-b977-5abdf0dd3e31 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-79375774-1f89-4837-a9f0-8f45edf19e63 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:30 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-79375774-1f89-4837-a9f0-8f45edf19e63 Jul 08 01:22:30 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:31 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3b5f9cc2-1ab8-4f29-b977-5abdf0dd3e31 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-79375774-1f89-4837-a9f0-8f45edf19e63" returned: 0 in 0.697s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3b5f9cc2-1ab8-4f29-b977-5abdf0dd3e31 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "cinder-quobyte-79375774-1f89-4837-a9f0-8f45edf19e63" released by "delete_volume" :: held 1.749s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:31 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-3b5f9cc2-1ab8-4f29-b977-5abdf0dd3e31 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Created reservations ['aa704ab7-ec8f-4a06-9272-1a3c6cda78d4', '30b7b430-ba52-44d5-8fc9-3c9fed1b694e', 'b9a6a271-d509-42c7-a014-2c77b7464d26', '3d7b382a-2c89-4c09-921b-189a152331ec'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:22:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3b5f9cc2-1ab8-4f29-b977-5abdf0dd3e31 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3b5f9cc2-1ab8-4f29-b977-5abdf0dd3e31 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3b5f9cc2-1ab8-4f29-b977-5abdf0dd3e31 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3b5f9cc2-1ab8-4f29-b977-5abdf0dd3e31 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3b5f9cc2-1ab8-4f29-b977-5abdf0dd3e31 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3b5f9cc2-1ab8-4f29-b977-5abdf0dd3e31 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:31 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:22:31 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e1598239-f650-4d49-bab9-129c7c4efbd8 tempest-TestInstancesWithCinderVolumes-269993021 None] Acquiring lock "cinder-eb620007-70a3-48d1-8e72-b0272e04f0a3-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e1598239-f650-4d49-bab9-129c7c4efbd8 tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "cinder-eb620007-70a3-48d1-8e72-b0272e04f0a3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e1598239-f650-4d49-bab9-129c7c4efbd8 tempest-TestInstancesWithCinderVolumes-269993021 None] Acquiring lock "cinder-quobyte-eb620007-70a3-48d1-8e72-b0272e04f0a3" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e1598239-f650-4d49-bab9-129c7c4efbd8 tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "cinder-quobyte-eb620007-70a3-48d1-8e72-b0272e04f0a3" acquired by "delete_volume" :: waited 0.017s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-db63cbb0-0993-4d2c-b46a-f210846a8fd8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "cinder-4a10b44e-4551-4255-b105-a2cd03b59d05-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:31 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afd9d46-8638-4f64-825b-0d7eaf443085]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e1598239-f650-4d49-bab9-129c7c4efbd8 tempest-TestInstancesWithCinderVolumes-269993021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:32 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-db63cbb0-0993-4d2c-b46a-f210846a8fd8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "cinder-4a10b44e-4551-4255-b105-a2cd03b59d05-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:32 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-db63cbb0-0993-4d2c-b46a-f210846a8fd8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "cinder-quobyte-4a10b44e-4551-4255-b105-a2cd03b59d05" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:32 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-db63cbb0-0993-4d2c-b46a-f210846a8fd8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "cinder-quobyte-4a10b44e-4551-4255-b105-a2cd03b59d05" acquired by "delete_volume" :: waited 0.025s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:32 devstack sudo[101463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3 Jul 08 01:22:32 devstack sudo[101463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:32 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c6890a-6aee-4913-a535-716466dcb803]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-db63cbb0-0993-4d2c-b46a-f210846a8fd8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4a10b44e-4551-4255-b105-a2cd03b59d05 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:32 devstack sudo[101465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4a10b44e-4551-4255-b105-a2cd03b59d05 Jul 08 01:22:32 devstack sudo[101465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:32 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3b5f9cc2-1ab8-4f29-b977-5abdf0dd3e31 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.066s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:32 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-3b5f9cc2-1ab8-4f29-b977-5abdf0dd3e31 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:22:32 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-3b5f9cc2-1ab8-4f29-b977-5abdf0dd3e31 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Deleted volume successfully. Jul 08 01:22:32 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3b5f9cc2-1ab8-4f29-b977-5abdf0dd3e31 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "cinder-79375774-1f89-4837-a9f0-8f45edf19e63-delete_volume" released by "delete_volume" :: held 3.110s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:33 devstack sudo[101463]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e1598239-f650-4d49-bab9-129c7c4efbd8 tempest-TestInstancesWithCinderVolumes-269993021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3" returned: 0 in 1.130s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e1598239-f650-4d49-bab9-129c7c4efbd8 tempest-TestInstancesWithCinderVolumes-269993021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:33 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3 Jul 08 01:22:33 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:33 devstack sudo[101465]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-db63cbb0-0993-4d2c-b46a-f210846a8fd8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4a10b44e-4551-4255-b105-a2cd03b59d05" returned: 0 in 1.319s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-db63cbb0-0993-4d2c-b46a-f210846a8fd8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4a10b44e-4551-4255-b105-a2cd03b59d05 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:33 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4a10b44e-4551-4255-b105-a2cd03b59d05 Jul 08 01:22:33 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:34 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e1598239-f650-4d49-bab9-129c7c4efbd8 tempest-TestInstancesWithCinderVolumes-269993021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3" returned: 1 in 0.879s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e1598239-f650-4d49-bab9-129c7c4efbd8 tempest-TestInstancesWithCinderVolumes-269993021 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:22:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e1598239-f650-4d49-bab9-129c7c4efbd8 tempest-TestInstancesWithCinderVolumes-269993021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:34 devstack sudo[101490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3 Jul 08 01:22:34 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:34 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-db63cbb0-0993-4d2c-b46a-f210846a8fd8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4a10b44e-4551-4255-b105-a2cd03b59d05" returned: 0 in 0.750s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:34 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-db63cbb0-0993-4d2c-b46a-f210846a8fd8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "cinder-quobyte-4a10b44e-4551-4255-b105-a2cd03b59d05" released by "delete_volume" :: held 2.135s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:34 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-db63cbb0-0993-4d2c-b46a-f210846a8fd8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Created reservations ['c3134306-fd9a-4b23-a4f1-5cd8199c665a', 'b60d2f18-64bd-4764-aa9a-d7021b5da43e', 'c4c11eb8-ddd5-4638-9cce-930433de6bed', 'ce202369-fc1c-489c-a3ac-410bc8657da9'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:22:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-db63cbb0-0993-4d2c-b46a-f210846a8fd8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-db63cbb0-0993-4d2c-b46a-f210846a8fd8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:34 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-db63cbb0-0993-4d2c-b46a-f210846a8fd8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:34 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-db63cbb0-0993-4d2c-b46a-f210846a8fd8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-db63cbb0-0993-4d2c-b46a-f210846a8fd8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-db63cbb0-0993-4d2c-b46a-f210846a8fd8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:34 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:22:34 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:34 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-301d06d2-f977-4d3d-a7a2-baa2a78851b2 req-dccddcb3-28d6-4017-9ec7-7a47a5aba3ec tempest-TestStampPattern-1012369784 None] Terminate volume connection completed successfully. Jul 08 01:22:34 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-301d06d2-f977-4d3d-a7a2-baa2a78851b2 req-dccddcb3-28d6-4017-9ec7-7a47a5aba3ec tempest-TestStampPattern-1012369784 None] Deleting attachment f9cd3221-bcd6-44d2-8a97-835839525986. {{(pid=87022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:22:34 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e1598239-f650-4d49-bab9-129c7c4efbd8 tempest-TestInstancesWithCinderVolumes-269993021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-eb620007-70a3-48d1-8e72-b0272e04f0a3" returned: 0 in 0.934s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:34 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e1598239-f650-4d49-bab9-129c7c4efbd8 tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "cinder-quobyte-eb620007-70a3-48d1-8e72-b0272e04f0a3" released by "delete_volume" :: held 3.042s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:34 devstack cinder-volume[87022]: WARNING cinder.quota [None req-e1598239-f650-4d49-bab9-129c7c4efbd8 tempest-TestInstancesWithCinderVolumes-269993021 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-744653914-1776767441 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-744653914-1776767441, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:22:34 devstack cinder-volume[87022]: WARNING cinder.quota [None req-e1598239-f650-4d49-bab9-129c7c4efbd8 tempest-TestInstancesWithCinderVolumes-269993021 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-744653914-1776767441 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-744653914-1776767441, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:22:35 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-e1598239-f650-4d49-bab9-129c7c4efbd8 tempest-TestInstancesWithCinderVolumes-269993021 None] Created reservations ['119f2f43-7fcc-4f6f-b75f-7933f7fc7194', 'bdee676f-9e3c-4d98-aa91-a5b90db254b7', 'e97e6300-dc1a-4dfa-87a0-0a4bba043ed0', 'fc56f7ae-732b-4d45-94eb-50e440c9f14e'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:22:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e1598239-f650-4d49-bab9-129c7c4efbd8 tempest-TestInstancesWithCinderVolumes-269993021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e1598239-f650-4d49-bab9-129c7c4efbd8 tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:35 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e1598239-f650-4d49-bab9-129c7c4efbd8 tempest-TestInstancesWithCinderVolumes-269993021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:35 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e1598239-f650-4d49-bab9-129c7c4efbd8 tempest-TestInstancesWithCinderVolumes-269993021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e1598239-f650-4d49-bab9-129c7c4efbd8 tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e1598239-f650-4d49-bab9-129c7c4efbd8 tempest-TestInstancesWithCinderVolumes-269993021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:35 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:22:35 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:35 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-db63cbb0-0993-4d2c-b46a-f210846a8fd8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.771s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:35 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-db63cbb0-0993-4d2c-b46a-f210846a8fd8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:22:35 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-db63cbb0-0993-4d2c-b46a-f210846a8fd8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Deleted volume successfully. Jul 08 01:22:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-db63cbb0-0993-4d2c-b46a-f210846a8fd8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "cinder-4a10b44e-4551-4255-b105-a2cd03b59d05-delete_volume" released by "delete_volume" :: held 3.247s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f95fbd03-070f-4ae5-a5d9-87b4ce8293d8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "cinder-abe64897-79ec-4b90-b046-329517cdee65-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f95fbd03-070f-4ae5-a5d9-87b4ce8293d8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "cinder-abe64897-79ec-4b90-b046-329517cdee65-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f95fbd03-070f-4ae5-a5d9-87b4ce8293d8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "cinder-quobyte-abe64897-79ec-4b90-b046-329517cdee65" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f95fbd03-070f-4ae5-a5d9-87b4ce8293d8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "cinder-quobyte-abe64897-79ec-4b90-b046-329517cdee65" acquired by "delete_volume" :: waited 0.017s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:35 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7aa7bc-3ae4-4a79-992a-b3eda1f33556]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f95fbd03-070f-4ae5-a5d9-87b4ce8293d8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-abe64897-79ec-4b90-b046-329517cdee65 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:35 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-abe64897-79ec-4b90-b046-329517cdee65 Jul 08 01:22:35 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:36 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e1598239-f650-4d49-bab9-129c7c4efbd8 tempest-TestInstancesWithCinderVolumes-269993021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.192s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:36 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-e1598239-f650-4d49-bab9-129c7c4efbd8 tempest-TestInstancesWithCinderVolumes-269993021 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:22:36 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-e1598239-f650-4d49-bab9-129c7c4efbd8 tempest-TestInstancesWithCinderVolumes-269993021 None] Deleted volume successfully. Jul 08 01:22:36 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e1598239-f650-4d49-bab9-129c7c4efbd8 tempest-TestInstancesWithCinderVolumes-269993021 None] Lock "cinder-eb620007-70a3-48d1-8e72-b0272e04f0a3-delete_volume" released by "delete_volume" :: held 4.501s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:36 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f95fbd03-070f-4ae5-a5d9-87b4ce8293d8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-abe64897-79ec-4b90-b046-329517cdee65" returned: 0 in 1.020s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f95fbd03-070f-4ae5-a5d9-87b4ce8293d8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-abe64897-79ec-4b90-b046-329517cdee65 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:36 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-abe64897-79ec-4b90-b046-329517cdee65 Jul 08 01:22:36 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8422692b-7c8b-42bd-a884-909ccccb27dd tempest-TestStampPattern-1012369784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8422692b-7c8b-42bd-a884-909ccccb27dd tempest-TestStampPattern-1012369784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:37 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-8422692b-7c8b-42bd-a884-909ccccb27dd tempest-TestStampPattern-1012369784 None] Creating offline snapshot f01bcfd7-c664-4c0c-ade4-be0cb60b4f16 of volume cfcb1279-1adf-460f-8a50-ee507a6fb22c {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:22:37 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[62793ef9-53ac-48ae-9875-70d3896d4869]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8422692b-7c8b-42bd-a884-909ccccb27dd tempest-TestStampPattern-1012369784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:37 devstack sudo[101511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c Jul 08 01:22:37 devstack sudo[101511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:37 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f95fbd03-070f-4ae5-a5d9-87b4ce8293d8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-abe64897-79ec-4b90-b046-329517cdee65" returned: 0 in 0.976s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:37 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f95fbd03-070f-4ae5-a5d9-87b4ce8293d8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "cinder-quobyte-abe64897-79ec-4b90-b046-329517cdee65" released by "delete_volume" :: held 2.075s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:37 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-f95fbd03-070f-4ae5-a5d9-87b4ce8293d8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Created reservations ['8ca13727-e240-4074-ad54-7343efda1374', 'd03f4929-ed19-41f5-ab8a-944ccef927a7', 'e3757943-f621-4786-b428-8e07298212de', 'be2e8f5e-fc80-44c0-9c79-2c567173529f'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:22:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f95fbd03-070f-4ae5-a5d9-87b4ce8293d8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f95fbd03-070f-4ae5-a5d9-87b4ce8293d8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f95fbd03-070f-4ae5-a5d9-87b4ce8293d8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f95fbd03-070f-4ae5-a5d9-87b4ce8293d8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f95fbd03-070f-4ae5-a5d9-87b4ce8293d8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f95fbd03-070f-4ae5-a5d9-87b4ce8293d8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:38 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:22:38 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:38 devstack sudo[101511]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8422692b-7c8b-42bd-a884-909ccccb27dd tempest-TestStampPattern-1012369784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c" returned: 0 in 1.140s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8422692b-7c8b-42bd-a884-909ccccb27dd tempest-TestStampPattern-1012369784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.f01bcfd7-c664-4c0c-ade4-be0cb60b4f16 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:38 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.f01bcfd7-c664-4c0c-ade4-be0cb60b4f16 1G Jul 08 01:22:38 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:38 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f95fbd03-070f-4ae5-a5d9-87b4ce8293d8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.895s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:38 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-f95fbd03-070f-4ae5-a5d9-87b4ce8293d8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:22:38 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-f95fbd03-070f-4ae5-a5d9-87b4ce8293d8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Deleted volume successfully. Jul 08 01:22:39 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3e4fa23a-c01f-4fdd-a6e1-3001d88f59be tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "cinder-4f5f96fe-f083-411c-b22a-aeafc3dc89fd-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:39 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3e4fa23a-c01f-4fdd-a6e1-3001d88f59be tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "cinder-4f5f96fe-f083-411c-b22a-aeafc3dc89fd-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:39 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f95fbd03-070f-4ae5-a5d9-87b4ce8293d8 tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "cinder-abe64897-79ec-4b90-b046-329517cdee65-delete_volume" released by "delete_volume" :: held 3.501s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:39 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3e4fa23a-c01f-4fdd-a6e1-3001d88f59be tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "cinder-quobyte-4f5f96fe-f083-411c-b22a-aeafc3dc89fd" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:39 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3e4fa23a-c01f-4fdd-a6e1-3001d88f59be tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "cinder-quobyte-4f5f96fe-f083-411c-b22a-aeafc3dc89fd" acquired by "delete_volume" :: waited 0.039s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:39 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11bf6e1-26b7-4dd2-9177-261321ab89fc]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3e4fa23a-c01f-4fdd-a6e1-3001d88f59be tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4f5f96fe-f083-411c-b22a-aeafc3dc89fd {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:39 devstack sudo[101524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4f5f96fe-f083-411c-b22a-aeafc3dc89fd Jul 08 01:22:39 devstack sudo[101524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:39 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8422692b-7c8b-42bd-a884-909ccccb27dd tempest-TestStampPattern-1012369784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.f01bcfd7-c664-4c0c-ade4-be0cb60b4f16 1G" returned: 0 in 1.315s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8422692b-7c8b-42bd-a884-909ccccb27dd tempest-TestStampPattern-1012369784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.f01bcfd7-c664-4c0c-ade4-be0cb60b4f16 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:39 devstack sudo[101530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.f01bcfd7-c664-4c0c-ade4-be0cb60b4f16 Jul 08 01:22:39 devstack sudo[101530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:40 devstack sudo[101524]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3e4fa23a-c01f-4fdd-a6e1-3001d88f59be tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4f5f96fe-f083-411c-b22a-aeafc3dc89fd" returned: 0 in 1.142s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3e4fa23a-c01f-4fdd-a6e1-3001d88f59be tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4f5f96fe-f083-411c-b22a-aeafc3dc89fd {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:40 devstack sudo[101535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4f5f96fe-f083-411c-b22a-aeafc3dc89fd Jul 08 01:22:40 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:41 devstack sudo[101530]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8422692b-7c8b-42bd-a884-909ccccb27dd tempest-TestStampPattern-1012369784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.f01bcfd7-c664-4c0c-ade4-be0cb60b4f16" returned: 0 in 1.138s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:41 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-8422692b-7c8b-42bd-a884-909ccccb27dd tempest-TestStampPattern-1012369784 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.f01bcfd7-c664-4c0c-ade4-be0cb60b4f16 is being set with open permissions: ugo+rw Jul 08 01:22:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8422692b-7c8b-42bd-a884-909ccccb27dd tempest-TestStampPattern-1012369784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.f01bcfd7-c664-4c0c-ade4-be0cb60b4f16 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:41 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.f01bcfd7-c664-4c0c-ade4-be0cb60b4f16 Jul 08 01:22:41 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:41 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3e4fa23a-c01f-4fdd-a6e1-3001d88f59be tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4f5f96fe-f083-411c-b22a-aeafc3dc89fd" returned: 0 in 1.178s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:41 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3e4fa23a-c01f-4fdd-a6e1-3001d88f59be tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "cinder-quobyte-4f5f96fe-f083-411c-b22a-aeafc3dc89fd" released by "delete_volume" :: held 2.395s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:41 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-3e4fa23a-c01f-4fdd-a6e1-3001d88f59be tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Created reservations ['14942acf-ec07-4958-9957-02fdfb104c25', '87c01d54-bdb4-4352-80d8-afe54b43e73b', '974792d9-835b-4af8-b594-6be0e48b46fb', '69c3a668-a483-4f72-ab53-c0f91d56b363'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:22:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3e4fa23a-c01f-4fdd-a6e1-3001d88f59be tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3e4fa23a-c01f-4fdd-a6e1-3001d88f59be tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:41 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3e4fa23a-c01f-4fdd-a6e1-3001d88f59be tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:41 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3e4fa23a-c01f-4fdd-a6e1-3001d88f59be tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3e4fa23a-c01f-4fdd-a6e1-3001d88f59be tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3e4fa23a-c01f-4fdd-a6e1-3001d88f59be tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:41 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:22:41 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:42 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8422692b-7c8b-42bd-a884-909ccccb27dd tempest-TestStampPattern-1012369784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.f01bcfd7-c664-4c0c-ade4-be0cb60b4f16" returned: 0 in 0.961s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8422692b-7c8b-42bd-a884-909ccccb27dd tempest-TestStampPattern-1012369784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:42 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.info Jul 08 01:22:42 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:42 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3e4fa23a-c01f-4fdd-a6e1-3001d88f59be tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.125s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:42 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-3e4fa23a-c01f-4fdd-a6e1-3001d88f59be tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:22:42 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-3e4fa23a-c01f-4fdd-a6e1-3001d88f59be tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Deleted volume successfully. Jul 08 01:22:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3e4fa23a-c01f-4fdd-a6e1-3001d88f59be tempest-CreateVolumesFromSourceVolumeTest-1433831308 None] Lock "cinder-4f5f96fe-f083-411c-b22a-aeafc3dc89fd-delete_volume" released by "delete_volume" :: held 3.918s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:43 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8422692b-7c8b-42bd-a884-909ccccb27dd tempest-TestStampPattern-1012369784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.info" returned: 0 in 1.138s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:43 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-8422692b-7c8b-42bd-a884-909ccccb27dd tempest-TestStampPattern-1012369784 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.info is being set with open permissions: ugo+rw Jul 08 01:22:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8422692b-7c8b-42bd-a884-909ccccb27dd tempest-TestStampPattern-1012369784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:43 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.info Jul 08 01:22:43 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:43 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8422692b-7c8b-42bd-a884-909ccccb27dd tempest-TestStampPattern-1012369784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.info" returned: 0 in 0.708s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8422692b-7c8b-42bd-a884-909ccccb27dd tempest-TestStampPattern-1012369784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.535s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:43 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-8422692b-7c8b-42bd-a884-909ccccb27dd tempest-TestStampPattern-1012369784 None] Create snapshot completed successfully Jul 08 01:22:45 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:22:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:45 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:22:45 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:46 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.128s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:46 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:22:46 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:22:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread count: 28 {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:22:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread info: [<_MainThread(MainThread, started 134382216167552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:22:49 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:22:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Flow 'volume_create_manager' (948ae7e6-358d-46f2-8de8-1796d5ef9b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:22:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (325c05a2-1ffb-4e68-92e7-c1f738e260e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (325c05a2-1ffb-4e68-92e7-c1f738e260e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-803609102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88d9a280e1d94603a0237952b21e289b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:22:49Z,use_quota=True,user_id='450ad829647f4951a6768566691beda2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539e9fb8-35a5-4669-a5c7-82882c9bfbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539e9fb8-35a5-4669-a5c7-82882c9bfbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5d6c04-2fff-4877-a2dc-67253d205a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5d6c04-2fff-4877-a2dc-67253d205a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74', 'volume_name': 'volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30669764-9812-4f66-8cfe-446089be6933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30669764-9812-4f66-8cfe-446089be6933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:49 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf56247-9579-49f8-9f21-02bd8800ccc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:49 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Volume 88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74', 'volume_size': 1} Jul 08 01:22:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:49 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-803609102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88d9a280e1d94603a0237952b21e289b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:22:49Z,use_quota=True,user_id='450ad829647f4951a6768566691beda2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:22:49 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Creating volume 88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:22:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:49 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:49 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:49 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:22:49 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:22:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:49 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74 1073741824 Jul 08 01:22:49 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:50 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74 1073741824" returned: 0 in 1.200s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:50 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74 Jul 08 01:22:50 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:51 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74" returned: 0 in 0.906s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:51 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] <== create_volume: return (2201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:22:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.204s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:51 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf56247-9579-49f8-9f21-02bd8800ccc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:51 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bb484e6-0187-4cff-a998-3ee1b957b35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:51 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Volume volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74 (88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74): created successfully Jul 08 01:22:51 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bb484e6-0187-4cff-a998-3ee1b957b35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:51 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Flow 'volume_create_manager' (948ae7e6-358d-46f2-8de8-1796d5ef9b65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:22:51 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-c2cf6657-3ed7-46eb-bdcf-c44b402023cc tempest-VolumeDependencyTests-1095681554 None] Created volume successfully. Jul 08 01:22:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6a531c2a-3cbc-4fc8-a8f2-ab775de8aebd tempest-VolumeDependencyTests-1095681554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6a531c2a-3cbc-4fc8-a8f2-ab775de8aebd tempest-VolumeDependencyTests-1095681554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-6a531c2a-3cbc-4fc8-a8f2-ab775de8aebd tempest-VolumeDependencyTests-1095681554 None] Creating offline snapshot 1776a482-3233-467a-92b9-78c6fcf38429 of volume 88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:22:52 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd09d197-8eea-4157-9a03-84ad21392fbb]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6a531c2a-3cbc-4fc8-a8f2-ab775de8aebd tempest-VolumeDependencyTests-1095681554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:53 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74 Jul 08 01:22:53 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:54 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6a531c2a-3cbc-4fc8-a8f2-ab775de8aebd tempest-VolumeDependencyTests-1095681554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74" returned: 0 in 1.229s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6a531c2a-3cbc-4fc8-a8f2-ab775de8aebd tempest-VolumeDependencyTests-1095681554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.1776a482-3233-467a-92b9-78c6fcf38429 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:54 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.1776a482-3233-467a-92b9-78c6fcf38429 1G Jul 08 01:22:54 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:55 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:22:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Flow 'volume_create_manager' (0c31738d-33fa-4563-8870-e70f65e4f9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:22:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8712223a-4d90-46a2-8bb3-774b12b47c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8712223a-4d90-46a2-8bb3-774b12b47c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-678243277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d977e3fb-df47-431c-8f55-848eaeff8fa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3333c9ca0b489dacc567baf39733cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:22:56Z,use_quota=True,user_id='2c79d6925f3c4cd28ee9a9edca9d765c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:55 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e45287-40fb-4c53-bbe9-c30bf71aad56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e45287-40fb-4c53-bbe9-c30bf71aad56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf854a4-f8cf-43c3-b1bb-fdffd86bfb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf854a4-f8cf-43c3-b1bb-fdffd86bfb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd977e3fb-df47-431c-8f55-848eaeff8fa5', 'volume_name': 'volume-d977e3fb-df47-431c-8f55-848eaeff8fa5', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72037e98-2313-4a66-a075-a1b383b57dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72037e98-2313-4a66-a075-a1b383b57dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (024682dd-4283-48ff-a807-6c36b782fd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:55 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Volume d977e3fb-df47-431c-8f55-848eaeff8fa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d977e3fb-df47-431c-8f55-848eaeff8fa5', 'volume_size': 1} Jul 08 01:22:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6a531c2a-3cbc-4fc8-a8f2-ab775de8aebd tempest-VolumeDependencyTests-1095681554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.1776a482-3233-467a-92b9-78c6fcf38429 1G" returned: 0 in 1.591s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6a531c2a-3cbc-4fc8-a8f2-ab775de8aebd tempest-VolumeDependencyTests-1095681554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.1776a482-3233-467a-92b9-78c6fcf38429 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:55 devstack sudo[101619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.1776a482-3233-467a-92b9-78c6fcf38429 Jul 08 01:22:55 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:56 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6a531c2a-3cbc-4fc8-a8f2-ab775de8aebd tempest-VolumeDependencyTests-1095681554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.1776a482-3233-467a-92b9-78c6fcf38429" returned: 0 in 0.923s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:56 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-6a531c2a-3cbc-4fc8-a8f2-ab775de8aebd tempest-VolumeDependencyTests-1095681554 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.1776a482-3233-467a-92b9-78c6fcf38429 is being set with open permissions: ugo+rw Jul 08 01:22:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6a531c2a-3cbc-4fc8-a8f2-ab775de8aebd tempest-VolumeDependencyTests-1095681554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.1776a482-3233-467a-92b9-78c6fcf38429 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:56 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.1776a482-3233-467a-92b9-78c6fcf38429 Jul 08 01:22:56 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:57 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6a531c2a-3cbc-4fc8-a8f2-ab775de8aebd tempest-VolumeDependencyTests-1095681554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.1776a482-3233-467a-92b9-78c6fcf38429" returned: 0 in 0.752s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6a531c2a-3cbc-4fc8-a8f2-ab775de8aebd tempest-VolumeDependencyTests-1095681554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:57 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.info Jul 08 01:22:57 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:57 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:22:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Flow 'volume_create_manager' (c62707c6-a2ed-484e-ae9d-941c439f34f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:22:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55645bc6-4cf1-4c46-bb9e-b47a6f6104be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55645bc6-4cf1-4c46-bb9e-b47a6f6104be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1712446893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2004b538-a372-4bd4-baa0-29310313f7c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42274406b940457886e4b0a7a41b4a8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f01bcfd7-c664-4c0c-ade4-be0cb60b4f16,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:22:58Z,use_quota=True,user_id='cdc97d725eec462291577276ac24b2c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee9ace2f-e252-4eab-a3fc-43ae4760d0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee9ace2f-e252-4eab-a3fc-43ae4760d0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e2111c1-ad08-4d93-a290-3afaa8bfddee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e2111c1-ad08-4d93-a290-3afaa8bfddee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2004b538-a372-4bd4-baa0-29310313f7c7', 'volume_name': 'volume-2004b538-a372-4bd4-baa0-29310313f7c7', 'volume_size': 1, 'snapshot_id': 'f01bcfd7-c664-4c0c-ade4-be0cb60b4f16'}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65cf2752-4c8b-4531-b2bb-a5c0b1047161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65cf2752-4c8b-4531-b2bb-a5c0b1047161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb4235c-806f-4fbe-aca4-452c8c7ec4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:57 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Volume 2004b538-a372-4bd4-baa0-29310313f7c7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2004b538-a372-4bd4-baa0-29310313f7c7', 'volume_size': 1, 'snapshot_id': 'f01bcfd7-c664-4c0c-ade4-be0cb60b4f16'} Jul 08 01:22:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:58 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6a531c2a-3cbc-4fc8-a8f2-ab775de8aebd tempest-VolumeDependencyTests-1095681554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.info" returned: 0 in 0.806s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:58 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-6a531c2a-3cbc-4fc8-a8f2-ab775de8aebd tempest-VolumeDependencyTests-1095681554 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.info is being set with open permissions: ugo+rw Jul 08 01:22:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6a531c2a-3cbc-4fc8-a8f2-ab775de8aebd tempest-VolumeDependencyTests-1095681554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:58 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.info Jul 08 01:22:58 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6a531c2a-3cbc-4fc8-a8f2-ab775de8aebd tempest-VolumeDependencyTests-1095681554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.info" returned: 0 in 0.759s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:59 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6a531c2a-3cbc-4fc8-a8f2-ab775de8aebd tempest-VolumeDependencyTests-1095681554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.193s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.334s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-678243277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d977e3fb-df47-431c-8f55-848eaeff8fa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3333c9ca0b489dacc567baf39733cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:22:56Z,use_quota=True,user_id='2c79d6925f3c4cd28ee9a9edca9d765c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:22:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Creating volume d977e3fb-df47-431c-8f55-848eaeff8fa5 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:22:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:22:59 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:22:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d977e3fb-df47-431c-8f55-848eaeff8fa5 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:59 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d977e3fb-df47-431c-8f55-848eaeff8fa5 1073741824 Jul 08 01:22:59 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:59 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-6a531c2a-3cbc-4fc8-a8f2-ab775de8aebd tempest-VolumeDependencyTests-1095681554 None] Create snapshot completed successfully Jul 08 01:23:00 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d977e3fb-df47-431c-8f55-848eaeff8fa5 1073741824" returned: 0 in 1.342s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d977e3fb-df47-431c-8f55-848eaeff8fa5 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:00 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d977e3fb-df47-431c-8f55-848eaeff8fa5 Jul 08 01:23:00 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:01 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d977e3fb-df47-431c-8f55-848eaeff8fa5" returned: 0 in 0.757s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] <== create_volume: return (2160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.164s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.427s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Acquiring lock "cinder-quobyte-f01bcfd7-c664-4c0c-ade4-be0cb60b4f16-2004b538-a372-4bd4-baa0-29310313f7c7" by "_create_volume_from_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (024682dd-4283-48ff-a807-6c36b782fd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d977e3fb-df47-431c-8f55-848eaeff8fa5', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e92147-2193-41eb-a298-638917a7ad67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Lock "cinder-quobyte-f01bcfd7-c664-4c0c-ade4-be0cb60b4f16-2004b538-a372-4bd4-baa0-29310313f7c7" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Creating volume 2004b538-a372-4bd4-baa0-29310313f7c7 from snapshot f01bcfd7-c664-4c0c-ade4-be0cb60b4f16 {{(pid=87022) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Acquiring lock "cinder-quobyte-2004b538-a372-4bd4-baa0-29310313f7c7" by "_copy_volume_from_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:01 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Volume volume-d977e3fb-df47-431c-8f55-848eaeff8fa5 (d977e3fb-df47-431c-8f55-848eaeff8fa5): created successfully Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e92147-2193-41eb-a298-638917a7ad67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Flow 'volume_create_manager' (0c31738d-33fa-4563-8870-e70f65e4f9c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Lock "cinder-quobyte-2004b538-a372-4bd4-baa0-29310313f7c7" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] snapshot: f01bcfd7-c664-4c0c-ade4-be0cb60b4f16, volume: 2004b538-a372-4bd4-baa0-29310313f7c7, {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:23:01 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-9a59732b-3456-40d5-9468-ef2a76cf5968 tempest-ProjectReaderTests-82126436 None] Created volume successfully. Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b9f21c-635f-498d-8dc0-fadedf7da96e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.f01bcfd7-c664-4c0c-ade4-be0cb60b4f16 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Flow 'volume_create_manager' (0d791078-2f27-493e-b011-4b552bed33aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cd33864-89ae-4c48-a06b-24813c931559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:01 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.f01bcfd7-c664-4c0c-ade4-be0cb60b4f16 Jul 08 01:23:01 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cd33864-89ae-4c48-a06b-24813c931559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1634174371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6308313-9e9e-4faf-af44-a28b1f0efb84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88d9a280e1d94603a0237952b21e289b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1776a482-3233-467a-92b9-78c6fcf38429,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:01Z,use_quota=True,user_id='450ad829647f4951a6768566691beda2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3363a61-7696-4866-857b-cac6401fa76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3363a61-7696-4866-857b-cac6401fa76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9eff554-c01a-47fd-8131-1250c481edd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9eff554-c01a-47fd-8131-1250c481edd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e6308313-9e9e-4faf-af44-a28b1f0efb84', 'volume_name': 'volume-e6308313-9e9e-4faf-af44-a28b1f0efb84', 'volume_size': 1, 'snapshot_id': '1776a482-3233-467a-92b9-78c6fcf38429'}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ec0707d-7eef-47f3-aa97-2af5d0ed0f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ec0707d-7eef-47f3-aa97-2af5d0ed0f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea380fe-e79d-4bd6-b29d-4cf0662c311c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:01 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Volume e6308313-9e9e-4faf-af44-a28b1f0efb84: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e6308313-9e9e-4faf-af44-a28b1f0efb84', 'volume_size': 1, 'snapshot_id': '1776a482-3233-467a-92b9-78c6fcf38429'} Jul 08 01:23:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:02 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-08830f6e-8ebf-4d12-bb9a-0f693a8d6d11 tempest-ProjectReaderTests-82126436 None] Acquiring lock "cinder-d977e3fb-df47-431c-8f55-848eaeff8fa5-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:02 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-08830f6e-8ebf-4d12-bb9a-0f693a8d6d11 tempest-ProjectReaderTests-82126436 None] Lock "cinder-d977e3fb-df47-431c-8f55-848eaeff8fa5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:02 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-08830f6e-8ebf-4d12-bb9a-0f693a8d6d11 tempest-ProjectReaderTests-82126436 None] Acquiring lock "cinder-quobyte-d977e3fb-df47-431c-8f55-848eaeff8fa5" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:02 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:02 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-08830f6e-8ebf-4d12-bb9a-0f693a8d6d11 tempest-ProjectReaderTests-82126436 None] Lock "cinder-quobyte-d977e3fb-df47-431c-8f55-848eaeff8fa5" acquired by "delete_volume" :: waited 0.030s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.f01bcfd7-c664-4c0c-ade4-be0cb60b4f16" returned: 0 in 0.978s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:23:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] will copy from snapshot at /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:23:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Creating direct copy from snapshot {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:23:02 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d584bf29-7ec1-4053-9d0b-fb8342abcb14]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:02 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b79f051-6cea-416f-85e1-a7fbed6b8965]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-08830f6e-8ebf-4d12-bb9a-0f693a8d6d11 tempest-ProjectReaderTests-82126436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d977e3fb-df47-431c-8f55-848eaeff8fa5 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:02 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c Jul 08 01:23:02 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:02 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d977e3fb-df47-431c-8f55-848eaeff8fa5 Jul 08 01:23:02 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:03 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-08830f6e-8ebf-4d12-bb9a-0f693a8d6d11 tempest-ProjectReaderTests-82126436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d977e3fb-df47-431c-8f55-848eaeff8fa5" returned: 0 in 0.969s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-08830f6e-8ebf-4d12-bb9a-0f693a8d6d11 tempest-ProjectReaderTests-82126436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d977e3fb-df47-431c-8f55-848eaeff8fa5 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:03 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d977e3fb-df47-431c-8f55-848eaeff8fa5 Jul 08 01:23:03 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:03 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c" returned: 0 in 1.143s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:03 devstack cinder-volume[87022]: DEBUG cinder.utils [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Path /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2004b538-a372-4bd4-baa0-29310313f7c7 not found in is_blk_device check {{(pid=87022) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:23:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2004b538-a372-4bd4-baa0-29310313f7c7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:03 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2004b538-a372-4bd4-baa0-29310313f7c7 Jul 08 01:23:03 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:04 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-08830f6e-8ebf-4d12-bb9a-0f693a8d6d11 tempest-ProjectReaderTests-82126436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d977e3fb-df47-431c-8f55-848eaeff8fa5" returned: 0 in 1.193s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:04 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-08830f6e-8ebf-4d12-bb9a-0f693a8d6d11 tempest-ProjectReaderTests-82126436 None] Lock "cinder-quobyte-d977e3fb-df47-431c-8f55-848eaeff8fa5" released by "delete_volume" :: held 2.246s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:04 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-08830f6e-8ebf-4d12-bb9a-0f693a8d6d11 tempest-ProjectReaderTests-82126436 None] Created reservations ['8bf1d49b-4025-4f8a-b0f8-7b0ed7859c32', '51bd0d1e-8183-4bc2-a675-d225cc38844b', 'a02abaf4-d06b-45c6-a855-a8b3ce0d35e8', '3daef65c-2762-4fbd-9f12-ca99628a9172'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:23:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-08830f6e-8ebf-4d12-bb9a-0f693a8d6d11 tempest-ProjectReaderTests-82126436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-08830f6e-8ebf-4d12-bb9a-0f693a8d6d11 tempest-ProjectReaderTests-82126436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-08830f6e-8ebf-4d12-bb9a-0f693a8d6d11 tempest-ProjectReaderTests-82126436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-08830f6e-8ebf-4d12-bb9a-0f693a8d6d11 tempest-ProjectReaderTests-82126436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-08830f6e-8ebf-4d12-bb9a-0f693a8d6d11 tempest-ProjectReaderTests-82126436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-08830f6e-8ebf-4d12-bb9a-0f693a8d6d11 tempest-ProjectReaderTests-82126436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:05 devstack sudo[101678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:23:05 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:07 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-08830f6e-8ebf-4d12-bb9a-0f693a8d6d11 tempest-ProjectReaderTests-82126436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 2.292s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:07 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-08830f6e-8ebf-4d12-bb9a-0f693a8d6d11 tempest-ProjectReaderTests-82126436 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:23:07 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-08830f6e-8ebf-4d12-bb9a-0f693a8d6d11 tempest-ProjectReaderTests-82126436 None] Deleted volume successfully. Jul 08 01:23:07 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-08830f6e-8ebf-4d12-bb9a-0f693a8d6d11 tempest-ProjectReaderTests-82126436 None] Lock "cinder-d977e3fb-df47-431c-8f55-848eaeff8fa5-delete_volume" released by "delete_volume" :: held 5.029s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:08 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:23:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Flow 'volume_create_manager' (6dbd945c-7559-4755-9ba0-019110fecc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09131cad-c2fa-4737-b0c1-9c34d9effcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09131cad-c2fa-4737-b0c1-9c34d9effcfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-532949431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0043041b-f13c-43e6-a242-f2e929bb85c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce50b5cb504c436ba465dabab8810214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:08Z,use_quota=True,user_id='ca4a27f7c384483d8454d9451654e288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b85b5f42-d75c-4e07-b860-ae7b4716ee1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b85b5f42-d75c-4e07-b860-ae7b4716ee1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53429373-59bd-48a7-844b-41ae83532f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:08 devstack cinder-volume[87022]: DEBUG cinder.image.glance [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Creating Keystone auth plugin from conf {{(pid=87022) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:23:08 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:23:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Flow 'volume_create_manager' (7b14243a-4c5a-430e-9ce9-d91173d9955c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1655a84-ef61-4d02-bc4e-3a67ab32ced4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1655a84-ef61-4d02-bc4e-3a67ab32ced4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1961549600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63f8ac76-aca6-4247-9e3a-10b2f289a9eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3333c9ca0b489dacc567baf39733cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:09Z,use_quota=True,user_id='2c79d6925f3c4cd28ee9a9edca9d765c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbf2669b-e384-4695-8dec-5420a0b57b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbf2669b-e384-4695-8dec-5420a0b57b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1388384-bed0-432a-a31a-6711f5e3b841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1388384-bed0-432a-a31a-6711f5e3b841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63f8ac76-aca6-4247-9e3a-10b2f289a9eb', 'volume_name': 'volume-63f8ac76-aca6-4247-9e3a-10b2f289a9eb', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e862e0f7-1080-4977-b2c0-8bc4effb52fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e862e0f7-1080-4977-b2c0-8bc4effb52fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c513953-948a-4e6c-b17d-0a4c9d7db7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:09 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Volume 63f8ac76-aca6-4247-9e3a-10b2f289a9eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63f8ac76-aca6-4247-9e3a-10b2f289a9eb', 'volume_size': 1} Jul 08 01:23:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53429373-59bd-48a7-844b-41ae83532f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0043041b-f13c-43e6-a242-f2e929bb85c4', 'volume_name': 'volume-0043041b-f13c-43e6-a242-f2e929bb85c4', 'volume_size': 1, 'image_id': 'f4d67a52-db18-4750-abc4-5b7335c6e867', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4d67a52-db18-4750-abc4-5b7335c6e867', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81fea2dfa47f49cba26ad62301512b69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4d67a52-db18-4750-abc4-5b7335c6e867', 'created_at': datetime.datetime(2026, 7, 7, 22, 58, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 22, 58, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4d67a52-db18-4750-abc4-5b7335c6e867/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (608b12e0-8c51-4cd7-beb1-7bbd7c8218aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (608b12e0-8c51-4cd7-beb1-7bbd7c8218aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c625d4-28f4-4387-b4a5-af61a975d479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:11 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Volume 0043041b-f13c-43e6-a242-f2e929bb85c4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0043041b-f13c-43e6-a242-f2e929bb85c4', 'volume_size': 1, 'image_id': 'f4d67a52-db18-4750-abc4-5b7335c6e867', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4d67a52-db18-4750-abc4-5b7335c6e867', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81fea2dfa47f49cba26ad62301512b69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4d67a52-db18-4750-abc4-5b7335c6e867', 'created_at': datetime.datetime(2026, 7, 7, 22, 58, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 22, 58, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4d67a52-db18-4750-abc4-5b7335c6e867/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 01:23:11 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Trying to clone 0043041b-f13c-43e6-a242-f2e929bb85c4 from image f4d67a52-db18-4750-abc4-5b7335c6e867 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f4d67a52-db18-4750-abc4-5b7335c6e867', 'metadata': {}}]). {{(pid=87022) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:23:11 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2004b538-a372-4bd4-baa0-29310313f7c7" returned: 0 in 8.311s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:11 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e05a091-9eb1-47db-9c09-f31a9528cffb]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:12 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_p3lfawz4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87022) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:23:12 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Image download 20.69 MB at 20.69 MB/s Jul 08 01:23:12 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c Jul 08 01:23:12 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:12 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecf6d64-7a86-47d0-a83a-71815aa58cf3]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_p3lfawz4devstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:12 devstack sudo[101699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_p3lfawz4devstack@QuobyteHD Jul 08 01:23:12 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:12 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_p3lfawz4devstack@QuobyteHD" returned: 0 in 0.838s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:12 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Temporary image f4d67a52-db18-4750-abc4-5b7335c6e867 is fetched for user ca4a27f7c384483d8454d9451654e288. {{(pid=87022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:23:13 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4412dc1b-6666-4dd4-adf5-bc9ac7543ed5]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_p3lfawz4devstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:13 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c" returned: 0 in 1.216s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:13 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Image conversion details: src /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c, size 1024.00 MB, duration 8.31 sec, destination /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2004b538-a372-4bd4-baa0-29310313f7c7 {{(pid=87022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:23:13 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Converted 1024.00 MB image at 123.19 MB/s Jul 08 01:23:13 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2004b538-a372-4bd4-baa0-29310313f7c7 is being set with open permissions: ugo+rw Jul 08 01:23:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2004b538-a372-4bd4-baa0-29310313f7c7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:13 devstack sudo[101723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2004b538-a372-4bd4-baa0-29310313f7c7 Jul 08 01:23:13 devstack sudo[101723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:13 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_p3lfawz4devstack@QuobyteHD Jul 08 01:23:13 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:13 devstack sudo[101723]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2004b538-a372-4bd4-baa0-29310313f7c7" returned: 0 in 0.797s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:13 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Lock "cinder-quobyte-2004b538-a372-4bd4-baa0-29310313f7c7" released by "_copy_volume_from_snapshot" :: held 12.636s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:13 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Lock "cinder-quobyte-f01bcfd7-c664-4c0c-ade4-be0cb60b4f16-2004b538-a372-4bd4-baa0-29310313f7c7" released by "_create_volume_from_snapshot" :: held 12.698s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.748s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 12.328s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:13 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Acquiring lock "cinder-quobyte-1776a482-3233-467a-92b9-78c6fcf38429-e6308313-9e9e-4faf-af44-a28b1f0efb84" by "_create_volume_from_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Lock "cinder-quobyte-1776a482-3233-467a-92b9-78c6fcf38429-e6308313-9e9e-4faf-af44-a28b1f0efb84" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Creating volume e6308313-9e9e-4faf-af44-a28b1f0efb84 from snapshot 1776a482-3233-467a-92b9-78c6fcf38429 {{(pid=87022) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Acquiring lock "cinder-quobyte-e6308313-9e9e-4faf-af44-a28b1f0efb84" by "_copy_volume_from_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:14 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_p3lfawz4devstack@QuobyteHD" returned: 0 in 0.976s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb4235c-806f-4fbe-aca4-452c8c7ec4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2004b538-a372-4bd4-baa0-29310313f7c7', 'volume_size': 1, 'snapshot_id': 'f01bcfd7-c664-4c0c-ade4-be0cb60b4f16'}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b2491c-0c2d-4f8c-be20-4378c4a02974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Lock "cinder-quobyte-e6308313-9e9e-4faf-af44-a28b1f0efb84" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] snapshot: 1776a482-3233-467a-92b9-78c6fcf38429, volume: e6308313-9e9e-4faf-af44-a28b1f0efb84, {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:23:14 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Volume volume-2004b538-a372-4bd4-baa0-29310313f7c7 (2004b538-a372-4bd4-baa0-29310313f7c7): created successfully Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b2491c-0c2d-4f8c-be20-4378c4a02974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Flow 'volume_create_manager' (c62707c6-a2ed-484e-ae9d-941c439f34f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa83d81a-6152-4fbe-8704-46183329f1ba]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.1776a482-3233-467a-92b9-78c6fcf38429 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:14 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-ab9978ac-53c4-46f7-b36e-2597c41273cf tempest-TestStampPattern-1012369784 None] Created volume successfully. Jul 08 01:23:14 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.1776a482-3233-467a-92b9-78c6fcf38429 Jul 08 01:23:14 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:14 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.1776a482-3233-467a-92b9-78c6fcf38429" returned: 0 in 0.785s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] will copy from snapshot at /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74 {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Creating direct copy from snapshot {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2b0084-1bce-4e95-8763-4198e0330969]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:15 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74 Jul 08 01:23:15 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:15 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74" returned: 0 in 0.909s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:15 devstack cinder-volume[87022]: DEBUG cinder.utils [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Path /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e6308313-9e9e-4faf-af44-a28b1f0efb84 not found in is_blk_device check {{(pid=87022) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:23:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e6308313-9e9e-4faf-af44-a28b1f0efb84 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:15 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e6308313-9e9e-4faf-af44-a28b1f0efb84 Jul 08 01:23:15 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:22 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e6308313-9e9e-4faf-af44-a28b1f0efb84" returned: 0 in 6.347s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:22 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee9c945-1c0c-46d3-b3ac-ed9deb6323fb]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:22 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74 Jul 08 01:23:22 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:23 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74" returned: 0 in 0.996s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:23 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Image conversion details: src /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74, size 1024.00 MB, duration 6.35 sec, destination /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e6308313-9e9e-4faf-af44-a28b1f0efb84 {{(pid=87022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:23:23 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Converted 1024.00 MB image at 161.25 MB/s Jul 08 01:23:23 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e6308313-9e9e-4faf-af44-a28b1f0efb84 is being set with open permissions: ugo+rw Jul 08 01:23:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e6308313-9e9e-4faf-af44-a28b1f0efb84 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:23 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e6308313-9e9e-4faf-af44-a28b1f0efb84 Jul 08 01:23:23 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:23 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e6308313-9e9e-4faf-af44-a28b1f0efb84" returned: 0 in 0.758s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:23 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Lock "cinder-quobyte-e6308313-9e9e-4faf-af44-a28b1f0efb84" released by "_copy_volume_from_snapshot" :: held 9.922s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:23 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Lock "cinder-quobyte-1776a482-3233-467a-92b9-78c6fcf38429-e6308313-9e9e-4faf-af44-a28b1f0efb84" released by "_create_volume_from_snapshot" :: held 9.978s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.005s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.802s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1961549600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63f8ac76-aca6-4247-9e3a-10b2f289a9eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3333c9ca0b489dacc567baf39733cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:09Z,use_quota=True,user_id='2c79d6925f3c4cd28ee9a9edca9d765c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:23:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Creating volume 63f8ac76-aca6-4247-9e3a-10b2f289a9eb {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:23:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:23:24 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:23:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63f8ac76-aca6-4247-9e3a-10b2f289a9eb 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:24 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=93,cinder:UPDATE=130,cinder:INSERT=33,cinder:DELETE=8 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:23:24 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=112,cinder:INSERT=33,cinder:UPDATE=133,cinder:DELETE=13 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:23:24 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63f8ac76-aca6-4247-9e3a-10b2f289a9eb 1073741824 Jul 08 01:23:24 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea380fe-e79d-4bd6-b29d-4cf0662c311c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6308313-9e9e-4faf-af44-a28b1f0efb84', 'volume_size': 1, 'snapshot_id': '1776a482-3233-467a-92b9-78c6fcf38429'}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1feee365-6ca2-4a09-bb96-4b57e368122f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:24 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Volume volume-e6308313-9e9e-4faf-af44-a28b1f0efb84 (e6308313-9e9e-4faf-af44-a28b1f0efb84): created successfully Jul 08 01:23:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1feee365-6ca2-4a09-bb96-4b57e368122f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Flow 'volume_create_manager' (0d791078-2f27-493e-b011-4b552bed33aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:24 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-eb2fdd48-f069-47f1-a3d8-d02ca6dde442 tempest-VolumeDependencyTests-1095681554 None] Created volume successfully. Jul 08 01:23:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cf660db6-ae99-460f-8854-72fdf4c3058e tempest-VolumeDependencyTests-1095681554 None] Acquiring lock "cinder-1776a482-3233-467a-92b9-78c6fcf38429-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cf660db6-ae99-460f-8854-72fdf4c3058e tempest-VolumeDependencyTests-1095681554 None] Lock "cinder-1776a482-3233-467a-92b9-78c6fcf38429-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cf660db6-ae99-460f-8854-72fdf4c3058e tempest-VolumeDependencyTests-1095681554 None] Acquiring lock "cinder-quobyte-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cf660db6-ae99-460f-8854-72fdf4c3058e tempest-VolumeDependencyTests-1095681554 None] Lock "cinder-quobyte-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cf660db6-ae99-460f-8854-72fdf4c3058e tempest-VolumeDependencyTests-1095681554 None] Acquiring lock "cinder-quobyte-1776a482-3233-467a-92b9-78c6fcf38429" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cf660db6-ae99-460f-8854-72fdf4c3058e tempest-VolumeDependencyTests-1095681554 None] Lock "cinder-quobyte-1776a482-3233-467a-92b9-78c6fcf38429" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-cf660db6-ae99-460f-8854-72fdf4c3058e tempest-VolumeDependencyTests-1095681554 None] Deleting offline snapshot 1776a482-3233-467a-92b9-78c6fcf38429 of volume 88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:23:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-cf660db6-ae99-460f-8854-72fdf4c3058e tempest-VolumeDependencyTests-1095681554 None] snapshot_file for this snap is: volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.1776a482-3233-467a-92b9-78c6fcf38429 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:23:24 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b79f8a-7f7d-427b-823f-1801cf975d7b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cf660db6-ae99-460f-8854-72fdf4c3058e tempest-VolumeDependencyTests-1095681554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.1776a482-3233-467a-92b9-78c6fcf38429 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:24 devstack sudo[101863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.1776a482-3233-467a-92b9-78c6fcf38429 Jul 08 01:23:24 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:25 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63f8ac76-aca6-4247-9e3a-10b2f289a9eb 1073741824" returned: 0 in 1.013s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63f8ac76-aca6-4247-9e3a-10b2f289a9eb {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:25 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63f8ac76-aca6-4247-9e3a-10b2f289a9eb Jul 08 01:23:25 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:25 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cf660db6-ae99-460f-8854-72fdf4c3058e tempest-VolumeDependencyTests-1095681554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.1776a482-3233-467a-92b9-78c6fcf38429" returned: 0 in 0.892s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-cf660db6-ae99-460f-8854-72fdf4c3058e tempest-VolumeDependencyTests-1095681554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:23:25 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b39abf-c562-41d2-9f46-ac501f377968]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cf660db6-ae99-460f-8854-72fdf4c3058e tempest-VolumeDependencyTests-1095681554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:25 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74 Jul 08 01:23:25 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:25 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63f8ac76-aca6-4247-9e3a-10b2f289a9eb" returned: 0 in 0.807s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:23:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.837s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-532949431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0043041b-f13c-43e6-a242-f2e929bb85c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce50b5cb504c436ba465dabab8810214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:08Z,use_quota=True,user_id='ca4a27f7c384483d8454d9451654e288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:23:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Creating volume 0043041b-f13c-43e6-a242-f2e929bb85c4 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:23:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:23:25 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:23:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c513953-948a-4e6c-b17d-0a4c9d7db7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63f8ac76-aca6-4247-9e3a-10b2f289a9eb', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef99d275-8d99-4046-8d63-728a842401f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:25 devstack sudo[101878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4 1073741824 Jul 08 01:23:25 devstack sudo[101878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:25 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Volume volume-63f8ac76-aca6-4247-9e3a-10b2f289a9eb (63f8ac76-aca6-4247-9e3a-10b2f289a9eb): created successfully Jul 08 01:23:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef99d275-8d99-4046-8d63-728a842401f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Flow 'volume_create_manager' (7b14243a-4c5a-430e-9ce9-d91173d9955c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:25 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-efc05a83-7c75-48d3-ba5d-141fd9378d63 tempest-ProjectReaderTests-82126436 None] Created volume successfully. Jul 08 01:23:26 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4077db9b-2118-4ee0-a5c4-39d6c7bea4ab tempest-ProjectReaderTests-82126436 None] Acquiring lock "cinder-63f8ac76-aca6-4247-9e3a-10b2f289a9eb-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:26 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4077db9b-2118-4ee0-a5c4-39d6c7bea4ab tempest-ProjectReaderTests-82126436 None] Lock "cinder-63f8ac76-aca6-4247-9e3a-10b2f289a9eb-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:26 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4077db9b-2118-4ee0-a5c4-39d6c7bea4ab tempest-ProjectReaderTests-82126436 None] Acquiring lock "cinder-quobyte-63f8ac76-aca6-4247-9e3a-10b2f289a9eb" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:26 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4077db9b-2118-4ee0-a5c4-39d6c7bea4ab tempest-ProjectReaderTests-82126436 None] Lock "cinder-quobyte-63f8ac76-aca6-4247-9e3a-10b2f289a9eb" acquired by "delete_volume" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:26 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[512a5945-90b5-4961-b35b-7758c666f40e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4077db9b-2118-4ee0-a5c4-39d6c7bea4ab tempest-ProjectReaderTests-82126436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63f8ac76-aca6-4247-9e3a-10b2f289a9eb {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:26 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cf660db6-ae99-460f-8854-72fdf4c3058e tempest-VolumeDependencyTests-1095681554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74" returned: 0 in 1.045s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cf660db6-ae99-460f-8854-72fdf4c3058e tempest-VolumeDependencyTests-1095681554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.1776a482-3233-467a-92b9-78c6fcf38429 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:26 devstack sudo[101888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.1776a482-3233-467a-92b9-78c6fcf38429 Jul 08 01:23:26 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:26 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63f8ac76-aca6-4247-9e3a-10b2f289a9eb Jul 08 01:23:26 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:27 devstack sudo[101878]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4 1073741824" returned: 0 in 1.126s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:27 devstack sudo[101891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4 Jul 08 01:23:27 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:27 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4077db9b-2118-4ee0-a5c4-39d6c7bea4ab tempest-ProjectReaderTests-82126436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63f8ac76-aca6-4247-9e3a-10b2f289a9eb" returned: 0 in 0.915s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4077db9b-2118-4ee0-a5c4-39d6c7bea4ab tempest-ProjectReaderTests-82126436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63f8ac76-aca6-4247-9e3a-10b2f289a9eb {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:27 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63f8ac76-aca6-4247-9e3a-10b2f289a9eb Jul 08 01:23:27 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:27 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cf660db6-ae99-460f-8854-72fdf4c3058e tempest-VolumeDependencyTests-1095681554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.1776a482-3233-467a-92b9-78c6fcf38429" returned: 0 in 0.966s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cf660db6-ae99-460f-8854-72fdf4c3058e tempest-VolumeDependencyTests-1095681554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.1776a482-3233-467a-92b9-78c6fcf38429 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:27 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.1776a482-3233-467a-92b9-78c6fcf38429 Jul 08 01:23:27 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:27 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4" returned: 0 in 0.757s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] <== create_volume: return (1936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:23:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:27 devstack cinder-volume[87022]: DEBUG cinder.volume.volume_utils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Attempting download of f4d67a52-db18-4750-abc4-5b7335c6e867 ((None, [{'url': 'file:///opt/stack/data/glance/images/f4d67a52-db18-4750-abc4-5b7335c6e867', 'metadata': {}}])) to volume 0043041b-f13c-43e6-a242-f2e929bb85c4. {{(pid=87022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:23:27 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42f83f5-ecb5-44a8-bfb3-cd572b8274ef]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4d67a52-db18-4750-abc4-5b7335c6e867_cgoe8i_l {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:28 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4d67a52-db18-4750-abc4-5b7335c6e867_cgoe8i_l Jul 08 01:23:28 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:28 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cf660db6-ae99-460f-8854-72fdf4c3058e tempest-VolumeDependencyTests-1095681554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74.1776a482-3233-467a-92b9-78c6fcf38429" returned: 0 in 0.756s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cf660db6-ae99-460f-8854-72fdf4c3058e tempest-VolumeDependencyTests-1095681554 None] Lock "cinder-quobyte-1776a482-3233-467a-92b9-78c6fcf38429" released by "_delete_snapshot" :: held 3.786s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:28 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cf660db6-ae99-460f-8854-72fdf4c3058e tempest-VolumeDependencyTests-1095681554 None] Lock "cinder-quobyte-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74" released by "delete_snapshot" :: held 3.820s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4077db9b-2118-4ee0-a5c4-39d6c7bea4ab tempest-ProjectReaderTests-82126436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-63f8ac76-aca6-4247-9e3a-10b2f289a9eb" returned: 0 in 0.910s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4077db9b-2118-4ee0-a5c4-39d6c7bea4ab tempest-ProjectReaderTests-82126436 None] Lock "cinder-quobyte-63f8ac76-aca6-4247-9e3a-10b2f289a9eb" released by "delete_volume" :: held 1.874s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:28 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-4077db9b-2118-4ee0-a5c4-39d6c7bea4ab tempest-ProjectReaderTests-82126436 None] Created reservations ['c30c1ea0-9c31-41a7-aa1b-1aa2aefddd43', 'a2097f6b-b62a-4ed2-bc79-551715423a75', 'd9c9585e-6278-4ba0-9c1c-8330bc146032', '5f2e7ef8-28cf-468d-9048-e8119a7a5c2e'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:23:28 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-cf660db6-ae99-460f-8854-72fdf4c3058e tempest-VolumeDependencyTests-1095681554 None] Created reservations ['82328ed2-d320-4a96-bb52-b88f306d9367', 'c034c909-42c6-4ffc-84b7-893ad183b123', '118f5a91-34b4-46ef-8da6-24003c7107e3', '28728722-6e6e-4812-b849-eb3b1ecb0909'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:23:28 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-cf660db6-ae99-460f-8854-72fdf4c3058e tempest-VolumeDependencyTests-1095681554 None] Delete snapshot completed successfully. Jul 08 01:23:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cf660db6-ae99-460f-8854-72fdf4c3058e tempest-VolumeDependencyTests-1095681554 None] Lock "cinder-1776a482-3233-467a-92b9-78c6fcf38429-delete_snapshot" released by "delete_snapshot" :: held 4.062s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4077db9b-2118-4ee0-a5c4-39d6c7bea4ab tempest-ProjectReaderTests-82126436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4077db9b-2118-4ee0-a5c4-39d6c7bea4ab tempest-ProjectReaderTests-82126436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:28 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4077db9b-2118-4ee0-a5c4-39d6c7bea4ab tempest-ProjectReaderTests-82126436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:28 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4077db9b-2118-4ee0-a5c4-39d6c7bea4ab tempest-ProjectReaderTests-82126436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4077db9b-2118-4ee0-a5c4-39d6c7bea4ab tempest-ProjectReaderTests-82126436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4077db9b-2118-4ee0-a5c4-39d6c7bea4ab tempest-ProjectReaderTests-82126436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:28 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:23:28 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:28 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4d67a52-db18-4750-abc4-5b7335c6e867_cgoe8i_l" returned: 0 in 0.957s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4d67a52-db18-4750-abc4-5b7335c6e867_cgoe8i_l {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-9b3ebd01-71e6-421b-9f14-bcf0c8707191 tempest-VolumeDependencyTests-1095681554 None] Acquiring lock "cinder-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-9b3ebd01-71e6-421b-9f14-bcf0c8707191 tempest-VolumeDependencyTests-1095681554 None] Lock "cinder-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:29 devstack sudo[101914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4d67a52-db18-4750-abc4-5b7335c6e867_cgoe8i_l Jul 08 01:23:29 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-9b3ebd01-71e6-421b-9f14-bcf0c8707191 tempest-VolumeDependencyTests-1095681554 None] Acquiring lock "cinder-quobyte-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-9b3ebd01-71e6-421b-9f14-bcf0c8707191 tempest-VolumeDependencyTests-1095681554 None] Lock "cinder-quobyte-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74" acquired by "delete_volume" :: waited 0.036s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfeb52f-55e8-45e9-a5a4-cb34eb1ad4ec]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9b3ebd01-71e6-421b-9f14-bcf0c8707191 tempest-VolumeDependencyTests-1095681554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:29 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74 Jul 08 01:23:29 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Flow 'volume_create_manager' (25c11136-1220-4b02-90f1-a696a34336b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01ea29a-75c6-4f6e-9ffd-e387bc1b8594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:29 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01ea29a-75c6-4f6e-9ffd-e387bc1b8594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1179779249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d23a96-125e-4bfb-ad1f-59e4a18ac650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3333c9ca0b489dacc567baf39733cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:30Z,use_quota=True,user_id='2c79d6925f3c4cd28ee9a9edca9d765c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5d7e4e-ea10-4aee-957d-48cbe3f3a4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5d7e4e-ea10-4aee-957d-48cbe3f3a4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec7822e9-e017-468c-96ef-0683b2131a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec7822e9-e017-468c-96ef-0683b2131a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9d23a96-125e-4bfb-ad1f-59e4a18ac650', 'volume_name': 'volume-b9d23a96-125e-4bfb-ad1f-59e4a18ac650', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b87ca5-4b7c-42ed-b6dd-5f8376008b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b87ca5-4b7c-42ed-b6dd-5f8376008b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c7d129-0ed5-499f-8de8-0829eb28711f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:29 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Volume b9d23a96-125e-4bfb-ad1f-59e4a18ac650: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9d23a96-125e-4bfb-ad1f-59e4a18ac650', 'volume_size': 1} Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1179779249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d23a96-125e-4bfb-ad1f-59e4a18ac650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3333c9ca0b489dacc567baf39733cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:30Z,use_quota=True,user_id='2c79d6925f3c4cd28ee9a9edca9d765c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Creating volume b9d23a96-125e-4bfb-ad1f-59e4a18ac650 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:23:29 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b9d23a96-125e-4bfb-ad1f-59e4a18ac650 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4077db9b-2118-4ee0-a5c4-39d6c7bea4ab tempest-ProjectReaderTests-82126436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.116s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-4077db9b-2118-4ee0-a5c4-39d6c7bea4ab tempest-ProjectReaderTests-82126436 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:23:29 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-4077db9b-2118-4ee0-a5c4-39d6c7bea4ab tempest-ProjectReaderTests-82126436 None] Deleted volume successfully. Jul 08 01:23:29 devstack sudo[101919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b9d23a96-125e-4bfb-ad1f-59e4a18ac650 1073741824 Jul 08 01:23:29 devstack sudo[101919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:29 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4077db9b-2118-4ee0-a5c4-39d6c7bea4ab tempest-ProjectReaderTests-82126436 None] Lock "cinder-63f8ac76-aca6-4247-9e3a-10b2f289a9eb-delete_volume" released by "delete_volume" :: held 3.387s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:30 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4d67a52-db18-4750-abc4-5b7335c6e867_cgoe8i_l" returned: 1 in 1.200s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4d67a52-db18-4750-abc4-5b7335c6e867_cgoe8i_l' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:23:30 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0c7711-cfc4-4d1d-90b4-b602933a91a9]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_p3lfawz4devstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:30 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_p3lfawz4devstack@QuobyteHD Jul 08 01:23:30 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:30 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9b3ebd01-71e6-421b-9f14-bcf0c8707191 tempest-VolumeDependencyTests-1095681554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74" returned: 0 in 1.388s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9b3ebd01-71e6-421b-9f14-bcf0c8707191 tempest-VolumeDependencyTests-1095681554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:30 devstack sudo[101931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74 Jul 08 01:23:30 devstack sudo[101931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:30 devstack sudo[101919]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b9d23a96-125e-4bfb-ad1f-59e4a18ac650 1073741824" returned: 0 in 0.989s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b9d23a96-125e-4bfb-ad1f-59e4a18ac650 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:30 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b9d23a96-125e-4bfb-ad1f-59e4a18ac650 Jul 08 01:23:30 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:31 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_p3lfawz4devstack@QuobyteHD" returned: 0 in 0.986s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:31 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] f4d67a52-db18-4750-abc4-5b7335c6e867 was qcow2, converting to raw {{(pid=87022) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:23:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_p3lfawz4devstack@QuobyteHD /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:31 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_p3lfawz4devstack@QuobyteHD /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4 Jul 08 01:23:31 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:31 devstack sudo[101931]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9b3ebd01-71e6-421b-9f14-bcf0c8707191 tempest-VolumeDependencyTests-1095681554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74" returned: 0 in 0.858s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-9b3ebd01-71e6-421b-9f14-bcf0c8707191 tempest-VolumeDependencyTests-1095681554 None] Lock "cinder-quobyte-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74" released by "delete_volume" :: held 2.379s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:31 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-9b3ebd01-71e6-421b-9f14-bcf0c8707191 tempest-VolumeDependencyTests-1095681554 None] Created reservations ['422e8ed7-5b62-4be5-9f9a-8e40308f8412', '5872fa39-d263-42e0-adfd-98241503a971', '3f8599e9-0bf8-478e-b242-f696ffcfe205', 'f26660f9-f0e0-48bc-b0fb-112f61353255'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:23:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9b3ebd01-71e6-421b-9f14-bcf0c8707191 tempest-VolumeDependencyTests-1095681554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9b3ebd01-71e6-421b-9f14-bcf0c8707191 tempest-VolumeDependencyTests-1095681554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-9b3ebd01-71e6-421b-9f14-bcf0c8707191 tempest-VolumeDependencyTests-1095681554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-9b3ebd01-71e6-421b-9f14-bcf0c8707191 tempest-VolumeDependencyTests-1095681554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9b3ebd01-71e6-421b-9f14-bcf0c8707191 tempest-VolumeDependencyTests-1095681554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9b3ebd01-71e6-421b-9f14-bcf0c8707191 tempest-VolumeDependencyTests-1095681554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:31 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b9d23a96-125e-4bfb-ad1f-59e4a18ac650" returned: 0 in 0.880s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] <== create_volume: return (1918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:23:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:31 devstack sudo[101955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:23:31 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c7d129-0ed5-499f-8de8-0829eb28711f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9d23a96-125e-4bfb-ad1f-59e4a18ac650', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f05b5e2-b8d3-4954-8cbd-3aa186032877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:31 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Volume volume-b9d23a96-125e-4bfb-ad1f-59e4a18ac650 (b9d23a96-125e-4bfb-ad1f-59e4a18ac650): created successfully Jul 08 01:23:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f05b5e2-b8d3-4954-8cbd-3aa186032877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Flow 'volume_create_manager' (25c11136-1220-4b02-90f1-a696a34336b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:31 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-ad6543de-eb77-4e3d-9544-bc63b7f04e08 tempest-ProjectReaderTests-82126436 None] Created volume successfully. Jul 08 01:23:32 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9b3ebd01-71e6-421b-9f14-bcf0c8707191 tempest-VolumeDependencyTests-1095681554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.690s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:32 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-9b3ebd01-71e6-421b-9f14-bcf0c8707191 tempest-VolumeDependencyTests-1095681554 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:23:32 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-9b3ebd01-71e6-421b-9f14-bcf0c8707191 tempest-VolumeDependencyTests-1095681554 None] Deleted volume successfully. Jul 08 01:23:32 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-9b3ebd01-71e6-421b-9f14-bcf0c8707191 tempest-VolumeDependencyTests-1095681554 None] Lock "cinder-88a1f07c-1da6-4bd5-b13a-1f9c2de3fb74-delete_volume" released by "delete_volume" :: held 3.412s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:32 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-97c0c9ef-75d5-4b6e-bdd6-973021290b34 tempest-VolumeDependencyTests-1095681554 None] Acquiring lock "cinder-e6308313-9e9e-4faf-af44-a28b1f0efb84-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:32 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-97c0c9ef-75d5-4b6e-bdd6-973021290b34 tempest-VolumeDependencyTests-1095681554 None] Lock "cinder-e6308313-9e9e-4faf-af44-a28b1f0efb84-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:32 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-97c0c9ef-75d5-4b6e-bdd6-973021290b34 tempest-VolumeDependencyTests-1095681554 None] Acquiring lock "cinder-quobyte-e6308313-9e9e-4faf-af44-a28b1f0efb84" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:32 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-97c0c9ef-75d5-4b6e-bdd6-973021290b34 tempest-VolumeDependencyTests-1095681554 None] Lock "cinder-quobyte-e6308313-9e9e-4faf-af44-a28b1f0efb84" acquired by "delete_volume" :: waited 0.022s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:32 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0fa12e-924d-4899-b83e-f3b7908fc574]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-97c0c9ef-75d5-4b6e-bdd6-973021290b34 tempest-VolumeDependencyTests-1095681554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e6308313-9e9e-4faf-af44-a28b1f0efb84 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:32 devstack sudo[101965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e6308313-9e9e-4faf-af44-a28b1f0efb84 Jul 08 01:23:32 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ec1b03cf-2329-4359-9367-012eb5d5db92 tempest-ProjectReaderTests-82126436 None] Acquiring lock "cinder-b9d23a96-125e-4bfb-ad1f-59e4a18ac650-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ec1b03cf-2329-4359-9367-012eb5d5db92 tempest-ProjectReaderTests-82126436 None] Lock "cinder-b9d23a96-125e-4bfb-ad1f-59e4a18ac650-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ec1b03cf-2329-4359-9367-012eb5d5db92 tempest-ProjectReaderTests-82126436 None] Acquiring lock "cinder-quobyte-b9d23a96-125e-4bfb-ad1f-59e4a18ac650" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ec1b03cf-2329-4359-9367-012eb5d5db92 tempest-ProjectReaderTests-82126436 None] Lock "cinder-quobyte-b9d23a96-125e-4bfb-ad1f-59e4a18ac650" acquired by "delete_volume" :: waited 0.017s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:33 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54956e8-976f-4652-ad86-b261f449de1e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ec1b03cf-2329-4359-9367-012eb5d5db92 tempest-ProjectReaderTests-82126436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b9d23a96-125e-4bfb-ad1f-59e4a18ac650 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:33 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_p3lfawz4devstack@QuobyteHD /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4" returned: 0 in 2.232s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:33 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f4d67a52-db18-4750-abc4-5b7335c6e867_p3lfawz4devstack@QuobyteHD, size 112.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4 {{(pid=87022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:23:33 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Converted 112.00 MB image at 50.15 MB/s Jul 08 01:23:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:33 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4 1G Jul 08 01:23:33 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:33 devstack sudo[101967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b9d23a96-125e-4bfb-ad1f-59e4a18ac650 Jul 08 01:23:33 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:33 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-97c0c9ef-75d5-4b6e-bdd6-973021290b34 tempest-VolumeDependencyTests-1095681554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e6308313-9e9e-4faf-af44-a28b1f0efb84" returned: 0 in 0.955s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-97c0c9ef-75d5-4b6e-bdd6-973021290b34 tempest-VolumeDependencyTests-1095681554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e6308313-9e9e-4faf-af44-a28b1f0efb84 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:33 devstack sudo[101974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e6308313-9e9e-4faf-af44-a28b1f0efb84 Jul 08 01:23:33 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:34 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4 1G" returned: 0 in 0.776s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:34 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ec1b03cf-2329-4359-9367-012eb5d5db92 tempest-ProjectReaderTests-82126436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b9d23a96-125e-4bfb-ad1f-59e4a18ac650" returned: 0 in 0.831s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ec1b03cf-2329-4359-9367-012eb5d5db92 tempest-ProjectReaderTests-82126436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b9d23a96-125e-4bfb-ad1f-59e4a18ac650 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:34 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad1323e-6fe9-4d29-a2d5-dfe076914180]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:34 devstack sudo[101982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b9d23a96-125e-4bfb-ad1f-59e4a18ac650 Jul 08 01:23:34 devstack sudo[101982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:34 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4 Jul 08 01:23:34 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:34 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-97c0c9ef-75d5-4b6e-bdd6-973021290b34 tempest-VolumeDependencyTests-1095681554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e6308313-9e9e-4faf-af44-a28b1f0efb84" returned: 0 in 0.727s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:34 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-97c0c9ef-75d5-4b6e-bdd6-973021290b34 tempest-VolumeDependencyTests-1095681554 None] Lock "cinder-quobyte-e6308313-9e9e-4faf-af44-a28b1f0efb84" released by "delete_volume" :: held 1.728s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:34 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-97c0c9ef-75d5-4b6e-bdd6-973021290b34 tempest-VolumeDependencyTests-1095681554 None] Created reservations ['09ca291f-1848-4fe8-8362-a64c46fd88eb', 'bc8a4c52-2c66-4370-bc15-d8867bf9644d', '408da539-5047-4e7a-a72e-ecdd26eb0e56', 'f20a3582-a824-4e0f-be2f-c8044b133d5b'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:23:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-97c0c9ef-75d5-4b6e-bdd6-973021290b34 tempest-VolumeDependencyTests-1095681554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-97c0c9ef-75d5-4b6e-bdd6-973021290b34 tempest-VolumeDependencyTests-1095681554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:34 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-97c0c9ef-75d5-4b6e-bdd6-973021290b34 tempest-VolumeDependencyTests-1095681554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:34 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-97c0c9ef-75d5-4b6e-bdd6-973021290b34 tempest-VolumeDependencyTests-1095681554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-97c0c9ef-75d5-4b6e-bdd6-973021290b34 tempest-VolumeDependencyTests-1095681554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-97c0c9ef-75d5-4b6e-bdd6-973021290b34 tempest-VolumeDependencyTests-1095681554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:34 devstack sudo[101987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:23:34 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:34 devstack sudo[101982]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ec1b03cf-2329-4359-9367-012eb5d5db92 tempest-ProjectReaderTests-82126436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b9d23a96-125e-4bfb-ad1f-59e4a18ac650" returned: 0 in 0.695s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:34 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ec1b03cf-2329-4359-9367-012eb5d5db92 tempest-ProjectReaderTests-82126436 None] Lock "cinder-quobyte-b9d23a96-125e-4bfb-ad1f-59e4a18ac650" released by "delete_volume" :: held 1.584s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:34 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-ec1b03cf-2329-4359-9367-012eb5d5db92 tempest-ProjectReaderTests-82126436 None] Created reservations ['9fbe57cb-5d4e-4bf2-accd-eaf7a78b83d7', 'bce7aba9-2f72-4fe3-9284-447b05f8a955', '0a6505a9-e065-4327-885a-0933778b30f0', '34978397-2f33-452e-bb0b-ac509b6d66af'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:23:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ec1b03cf-2329-4359-9367-012eb5d5db92 tempest-ProjectReaderTests-82126436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ec1b03cf-2329-4359-9367-012eb5d5db92 tempest-ProjectReaderTests-82126436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:35 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ec1b03cf-2329-4359-9367-012eb5d5db92 tempest-ProjectReaderTests-82126436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:35 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ec1b03cf-2329-4359-9367-012eb5d5db92 tempest-ProjectReaderTests-82126436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ec1b03cf-2329-4359-9367-012eb5d5db92 tempest-ProjectReaderTests-82126436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ec1b03cf-2329-4359-9367-012eb5d5db92 tempest-ProjectReaderTests-82126436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:35 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:23:35 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:35 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4" returned: 0 in 0.926s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:35 devstack sudo[101994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4 Jul 08 01:23:35 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:35 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-97c0c9ef-75d5-4b6e-bdd6-973021290b34 tempest-VolumeDependencyTests-1095681554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.856s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:35 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-97c0c9ef-75d5-4b6e-bdd6-973021290b34 tempest-VolumeDependencyTests-1095681554 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:23:35 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-97c0c9ef-75d5-4b6e-bdd6-973021290b34 tempest-VolumeDependencyTests-1095681554 None] Deleted volume successfully. Jul 08 01:23:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-97c0c9ef-75d5-4b6e-bdd6-973021290b34 tempest-VolumeDependencyTests-1095681554 None] Lock "cinder-e6308313-9e9e-4faf-af44-a28b1f0efb84-delete_volume" released by "delete_volume" :: held 2.818s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:35 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ec1b03cf-2329-4359-9367-012eb5d5db92 tempest-ProjectReaderTests-82126436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.965s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:35 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-ec1b03cf-2329-4359-9367-012eb5d5db92 tempest-ProjectReaderTests-82126436 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:23:35 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-ec1b03cf-2329-4359-9367-012eb5d5db92 tempest-ProjectReaderTests-82126436 None] Deleted volume successfully. Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ec1b03cf-2329-4359-9367-012eb5d5db92 tempest-ProjectReaderTests-82126436 None] Lock "cinder-b9d23a96-125e-4bfb-ad1f-59e4a18ac650-delete_volume" released by "delete_volume" :: held 2.806s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:36 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Flow 'volume_create_manager' (46f9b3c8-8139-4868-8a0e-4d81a9778e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9268a57c-d621-40d2-8ceb-2d58bd82d717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4" returned: 1 in 1.109s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG cinder.volume.volume_utils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Downloaded image f4d67a52-db18-4750-abc4-5b7335c6e867 ((None, [{'url': 'file:///opt/stack/data/glance/images/f4d67a52-db18-4750-abc4-5b7335c6e867', 'metadata': {}}])) to volume 0043041b-f13c-43e6-a242-f2e929bb85c4 successfully. {{(pid=87022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Temporary image f4d67a52-db18-4750-abc4-5b7335c6e867 for user ca4a27f7c384483d8454d9451654e288 is deleted. {{(pid=87022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG cinder.volume.volume_utils [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Marking volume 0043041b-f13c-43e6-a242-f2e929bb85c4 as bootable. {{(pid=87022) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9268a57c-d621-40d2-8ceb-2d58bd82d717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1511968585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7daaa3b3-2f21-4408-8a07-a93bf0ba0a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3333c9ca0b489dacc567baf39733cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:36Z,use_quota=True,user_id='2c79d6925f3c4cd28ee9a9edca9d765c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b9e8c67-7ff7-4ed8-a1c7-86ef5fd971fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b9e8c67-7ff7-4ed8-a1c7-86ef5fd971fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb40b24-d699-4fb8-87fd-666a86875cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb40b24-d699-4fb8-87fd-666a86875cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7daaa3b3-2f21-4408-8a07-a93bf0ba0a9e', 'volume_name': 'volume-7daaa3b3-2f21-4408-8a07-a93bf0ba0a9e', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d383455-673c-49f0-bf92-6f6b0aa413ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d383455-673c-49f0-bf92-6f6b0aa413ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa417503-b4b4-41f9-9ee3-c48cb4af19de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:36 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Volume 7daaa3b3-2f21-4408-8a07-a93bf0ba0a9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7daaa3b3-2f21-4408-8a07-a93bf0ba0a9e', 'volume_size': 1} Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1511968585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7daaa3b3-2f21-4408-8a07-a93bf0ba0a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3333c9ca0b489dacc567baf39733cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:36Z,use_quota=True,user_id='2c79d6925f3c4cd28ee9a9edca9d765c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Creating volume 7daaa3b3-2f21-4408-8a07-a93bf0ba0a9e {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:23:36 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7daaa3b3-2f21-4408-8a07-a93bf0ba0a9e 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Copying metadata from image f4d67a52-db18-4750-abc4-5b7335c6e867 to 0043041b-f13c-43e6-a242-f2e929bb85c4. {{(pid=87022) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Creating volume glance metadata for volume 0043041b-f13c-43e6-a242-f2e929bb85c4 backed by image f4d67a52-db18-4750-abc4-5b7335c6e867 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f4d67a52-db18-4750-abc4-5b7335c6e867', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87022) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:23:36 devstack sudo[102001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7daaa3b3-2f21-4408-8a07-a93bf0ba0a9e 1073741824 Jul 08 01:23:36 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c625d4-28f4-4387-b4a5-af61a975d479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0043041b-f13c-43e6-a242-f2e929bb85c4', 'volume_size': 1, 'image_id': 'f4d67a52-db18-4750-abc4-5b7335c6e867', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4d67a52-db18-4750-abc4-5b7335c6e867', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81fea2dfa47f49cba26ad62301512b69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4d67a52-db18-4750-abc4-5b7335c6e867', 'created_at': datetime.datetime(2026, 7, 7, 22, 58, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 22, 58, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4d67a52-db18-4750-abc4-5b7335c6e867/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8d527c-b0b4-4fb1-bafb-c17ebbe00051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:36 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Volume volume-0043041b-f13c-43e6-a242-f2e929bb85c4 (0043041b-f13c-43e6-a242-f2e929bb85c4): created successfully Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8d527c-b0b4-4fb1-bafb-c17ebbe00051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Flow 'volume_create_manager' (6dbd945c-7559-4755-9ba0-019110fecc30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:36 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-75d05d2c-a11e-4934-a2fc-eb0b86162578 tempest-TestShelveInstance-205099010 None] Created volume successfully. Jul 08 01:23:37 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7daaa3b3-2f21-4408-8a07-a93bf0ba0a9e 1073741824" returned: 0 in 0.966s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7daaa3b3-2f21-4408-8a07-a93bf0ba0a9e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:37 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7daaa3b3-2f21-4408-8a07-a93bf0ba0a9e Jul 08 01:23:37 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:37 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7daaa3b3-2f21-4408-8a07-a93bf0ba0a9e" returned: 0 in 0.717s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:37 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:23:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa417503-b4b4-41f9-9ee3-c48cb4af19de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7daaa3b3-2f21-4408-8a07-a93bf0ba0a9e', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05f5aef3-0636-4cc6-8e74-13e9e8fe775f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:38 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Volume volume-7daaa3b3-2f21-4408-8a07-a93bf0ba0a9e (7daaa3b3-2f21-4408-8a07-a93bf0ba0a9e): created successfully Jul 08 01:23:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05f5aef3-0636-4cc6-8e74-13e9e8fe775f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Flow 'volume_create_manager' (46f9b3c8-8139-4868-8a0e-4d81a9778e03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:38 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-b5e41c44-b06b-47e4-bb35-99500d5de55c tempest-ProjectReaderTests-82126436 None] Created volume successfully. Jul 08 01:23:38 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7c853afa-7316-48cd-8459-78896e494451 tempest-ProjectReaderTests-82126436 None] Acquiring lock "cinder-7daaa3b3-2f21-4408-8a07-a93bf0ba0a9e-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:38 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7c853afa-7316-48cd-8459-78896e494451 tempest-ProjectReaderTests-82126436 None] Lock "cinder-7daaa3b3-2f21-4408-8a07-a93bf0ba0a9e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:38 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7c853afa-7316-48cd-8459-78896e494451 tempest-ProjectReaderTests-82126436 None] Acquiring lock "cinder-quobyte-7daaa3b3-2f21-4408-8a07-a93bf0ba0a9e" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:38 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7c853afa-7316-48cd-8459-78896e494451 tempest-ProjectReaderTests-82126436 None] Lock "cinder-quobyte-7daaa3b3-2f21-4408-8a07-a93bf0ba0a9e" acquired by "delete_volume" :: waited 0.015s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:38 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[313c081d-927b-4711-a2eb-baeef8849e75]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7c853afa-7316-48cd-8459-78896e494451 tempest-ProjectReaderTests-82126436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7daaa3b3-2f21-4408-8a07-a93bf0ba0a9e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:38 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7daaa3b3-2f21-4408-8a07-a93bf0ba0a9e Jul 08 01:23:38 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:39 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7c853afa-7316-48cd-8459-78896e494451 tempest-ProjectReaderTests-82126436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7daaa3b3-2f21-4408-8a07-a93bf0ba0a9e" returned: 0 in 0.909s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7c853afa-7316-48cd-8459-78896e494451 tempest-ProjectReaderTests-82126436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7daaa3b3-2f21-4408-8a07-a93bf0ba0a9e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:39 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7daaa3b3-2f21-4408-8a07-a93bf0ba0a9e Jul 08 01:23:39 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:39 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7c853afa-7316-48cd-8459-78896e494451 tempest-ProjectReaderTests-82126436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7daaa3b3-2f21-4408-8a07-a93bf0ba0a9e" returned: 0 in 0.681s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:39 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7c853afa-7316-48cd-8459-78896e494451 tempest-ProjectReaderTests-82126436 None] Lock "cinder-quobyte-7daaa3b3-2f21-4408-8a07-a93bf0ba0a9e" released by "delete_volume" :: held 1.633s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:40 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-7c853afa-7316-48cd-8459-78896e494451 tempest-ProjectReaderTests-82126436 None] Created reservations ['d34f9df3-41f6-4eeb-92d8-c5c1ec0cb9b5', '6b6f226a-bf11-4b4f-b924-6b311e833cd8', 'b2953acf-b10d-47b1-8515-9c7756a83e20', '5e22404b-5d83-45b9-9e5d-9324c89cc6a6'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:23:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7c853afa-7316-48cd-8459-78896e494451 tempest-ProjectReaderTests-82126436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7c853afa-7316-48cd-8459-78896e494451 tempest-ProjectReaderTests-82126436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:40 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7c853afa-7316-48cd-8459-78896e494451 tempest-ProjectReaderTests-82126436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:40 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7c853afa-7316-48cd-8459-78896e494451 tempest-ProjectReaderTests-82126436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7c853afa-7316-48cd-8459-78896e494451 tempest-ProjectReaderTests-82126436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7c853afa-7316-48cd-8459-78896e494451 tempest-ProjectReaderTests-82126436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:40 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:23:40 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:40 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7c853afa-7316-48cd-8459-78896e494451 tempest-ProjectReaderTests-82126436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.777s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:40 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-7c853afa-7316-48cd-8459-78896e494451 tempest-ProjectReaderTests-82126436 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:23:40 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-7c853afa-7316-48cd-8459-78896e494451 tempest-ProjectReaderTests-82126436 None] Deleted volume successfully. Jul 08 01:23:40 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7c853afa-7316-48cd-8459-78896e494451 tempest-ProjectReaderTests-82126436 None] Lock "cinder-7daaa3b3-2f21-4408-8a07-a93bf0ba0a9e-delete_volume" released by "delete_volume" :: held 2.639s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:41 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:23:41 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Flow 'volume_create_manager' (a32a9a85-7123-440a-8eec-5c4644a938d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:41 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d94990-6833-4dab-82b8-9b34bcc017f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:41 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d94990-6833-4dab-82b8-9b34bcc017f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cb15fcd-00da-4d10-a5eb-d7a06d566bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2628981f13f44c789dab6971a2eac59b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:41Z,use_quota=True,user_id='8fa2da82508b44bdb5823962187974bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:41 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c885a73d-ec16-4942-b4dc-b2ed17cfafd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:41 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c885a73d-ec16-4942-b4dc-b2ed17cfafd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:41 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f2459b9-9fe2-416e-b59c-71f1b7d707b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:41 devstack cinder-volume[87022]: DEBUG cinder.image.glance [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Creating Keystone auth plugin from conf {{(pid=87022) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:23:41 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f2459b9-9fe2-416e-b59c-71f1b7d707b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6cb15fcd-00da-4d10-a5eb-d7a06d566bce', 'volume_name': 'volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce', 'volume_size': 1, 'image_id': '3f061b59-1967-44c2-be41-8277a4605a8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f061b59-1967-44c2-be41-8277a4605a8c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1bf05b4be12a24bde09e6eed065f6474', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2628981f13f44c789dab6971a2eac59b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '10ead684cb01159b8f05fe288c8d99a060063ba5182ae8fb2ba81eeded013746e659079b1f4c0558066971abd2261678868b46e440fb7acdf01f8e8c9351fd8c', 'id': '3f061b59-1967-44c2-be41-8277a4605a8c', 'created_at': datetime.datetime(2026, 7, 7, 23, 23, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 23, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f061b59-1967-44c2-be41-8277a4605a8c/file', 'properties': {}}, 'image_service': }' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:41 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3547ae79-ce0e-4148-8b2c-b00bdc0b8166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:41 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3547ae79-ce0e-4148-8b2c-b00bdc0b8166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:41 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9f9686f-086a-46a8-9d04-90216a8dac77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:41 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Volume 6cb15fcd-00da-4d10-a5eb-d7a06d566bce: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce', 'volume_size': 1, 'image_id': '3f061b59-1967-44c2-be41-8277a4605a8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f061b59-1967-44c2-be41-8277a4605a8c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1bf05b4be12a24bde09e6eed065f6474', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2628981f13f44c789dab6971a2eac59b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '10ead684cb01159b8f05fe288c8d99a060063ba5182ae8fb2ba81eeded013746e659079b1f4c0558066971abd2261678868b46e440fb7acdf01f8e8c9351fd8c', 'id': '3f061b59-1967-44c2-be41-8277a4605a8c', 'created_at': datetime.datetime(2026, 7, 7, 23, 23, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 23, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f061b59-1967-44c2-be41-8277a4605a8c/file', 'properties': {}}, 'image_service': } Jul 08 01:23:41 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Trying to clone 6cb15fcd-00da-4d10-a5eb-d7a06d566bce from image 3f061b59-1967-44c2-be41-8277a4605a8c at location (None, [{'url': 'file:///opt/stack/data/glance/images/3f061b59-1967-44c2-be41-8277a4605a8c', 'metadata': {}}]). {{(pid=87022) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:23:41 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3f061b59-1967-44c2-be41-8277a4605a8c_oj1la0pgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87022) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:23:41 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Image download 0.00 MB at 0.00 MB/s Jul 08 01:23:41 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3f6c38-cd15-4a2e-893e-0d49e9dc4f4c]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f061b59-1967-44c2-be41-8277a4605a8c_oj1la0pgdevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:42 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f061b59-1967-44c2-be41-8277a4605a8c_oj1la0pgdevstack@QuobyteHD Jul 08 01:23:42 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:42 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f061b59-1967-44c2-be41-8277a4605a8c_oj1la0pgdevstack@QuobyteHD" returned: 0 in 0.969s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f061b59-1967-44c2-be41-8277a4605a8c_oj1la0pgdevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:43 devstack sudo[102029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f061b59-1967-44c2-be41-8277a4605a8c_oj1la0pgdevstack@QuobyteHD Jul 08 01:23:43 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:44 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f061b59-1967-44c2-be41-8277a4605a8c_oj1la0pgdevstack@QuobyteHD" returned: 1 in 1.181s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f061b59-1967-44c2-be41-8277a4605a8c_oj1la0pgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:23:44 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Temporary image 3f061b59-1967-44c2-be41-8277a4605a8c is fetched for user 8fa2da82508b44bdb5823962187974bb. {{(pid=87022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:23:44 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e51917f-e8e5-47df-a4a0-602295c6dbee]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f061b59-1967-44c2-be41-8277a4605a8c_oj1la0pgdevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:44 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f061b59-1967-44c2-be41-8277a4605a8c_oj1la0pgdevstack@QuobyteHD Jul 08 01:23:44 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-41570bb3-64fb-4521-8e03-b683d956401a req-b3eab76e-7195-4ee8-a984-17e032ee8625 tempest-TestShelveInstance-205099010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-41570bb3-64fb-4521-8e03-b683d956401a req-b3eab76e-7195-4ee8-a984-17e032ee8625 tempest-TestShelveInstance-205099010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:44 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a956bf6f-bca6-4a7f-98f4-c1a5a147874e]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-41570bb3-64fb-4521-8e03-b683d956401a req-b3eab76e-7195-4ee8-a984-17e032ee8625 tempest-TestShelveInstance-205099010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:44 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4 Jul 08 01:23:44 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:45 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f061b59-1967-44c2-be41-8277a4605a8c_oj1la0pgdevstack@QuobyteHD" returned: 0 in 1.073s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f061b59-1967-44c2-be41-8277a4605a8c_oj1la0pgdevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:45 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:23:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:45 devstack sudo[102048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f061b59-1967-44c2-be41-8277a4605a8c_oj1la0pgdevstack@QuobyteHD Jul 08 01:23:45 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:45 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:23:45 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:45 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-41570bb3-64fb-4521-8e03-b683d956401a req-b3eab76e-7195-4ee8-a984-17e032ee8625 tempest-TestShelveInstance-205099010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4" returned: 0 in 1.262s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-41570bb3-64fb-4521-8e03-b683d956401a req-b3eab76e-7195-4ee8-a984-17e032ee8625 tempest-TestShelveInstance-205099010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:46 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4 Jul 08 01:23:46 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:46 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f061b59-1967-44c2-be41-8277a4605a8c_oj1la0pgdevstack@QuobyteHD" returned: 1 in 0.973s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f061b59-1967-44c2-be41-8277a4605a8c_oj1la0pgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:23:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:46 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.250s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:46 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:23:46 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:23:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread count: 28 {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:23:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread info: [<_MainThread(MainThread, started 134382216167552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:23:46 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-41570bb3-64fb-4521-8e03-b683d956401a req-b3eab76e-7195-4ee8-a984-17e032ee8625 tempest-TestShelveInstance-205099010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4" returned: 1 in 1.022s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-41570bb3-64fb-4521-8e03-b683d956401a req-b3eab76e-7195-4ee8-a984-17e032ee8625 tempest-TestShelveInstance-205099010 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:23:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-41570bb3-64fb-4521-8e03-b683d956401a req-b3eab76e-7195-4ee8-a984-17e032ee8625 tempest-TestShelveInstance-205099010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.365s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.674s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:46 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cb15fcd-00da-4d10-a5eb-d7a06d566bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2628981f13f44c789dab6971a2eac59b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:41Z,use_quota=True,user_id='8fa2da82508b44bdb5823962187974bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:23:46 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Creating volume 6cb15fcd-00da-4d10-a5eb-d7a06d566bce {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:23:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:46 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:46 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:46 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:23:46 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:23:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:46 devstack sudo[102071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce 1073741824 Jul 08 01:23:47 devstack sudo[102071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:47 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-41570bb3-64fb-4521-8e03-b683d956401a req-b3eab76e-7195-4ee8-a984-17e032ee8625 tempest-TestShelveInstance-205099010 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d', 'name': 'volume-0043041b-f13c-43e6-a242-f2e929bb85c4', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '603d5b40-a4e3-4543-bd74-e567b5bc4cb9', 'enforce_multipath': True} {{(pid=87022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:23:47 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-41570bb3-64fb-4521-8e03-b683d956401a req-b3eab76e-7195-4ee8-a984-17e032ee8625 tempest-TestShelveInstance-205099010 None] attachment_update completed successfully. Jul 08 01:23:47 devstack sudo[102071]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce 1073741824" returned: 0 in 0.962s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:47 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce Jul 08 01:23:47 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:48 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce" returned: 0 in 0.742s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:48 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:23:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:48 devstack cinder-volume[87022]: DEBUG cinder.volume.volume_utils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Attempting download of 3f061b59-1967-44c2-be41-8277a4605a8c ((None, [{'url': 'file:///opt/stack/data/glance/images/3f061b59-1967-44c2-be41-8277a4605a8c', 'metadata': {}}])) to volume 6cb15fcd-00da-4d10-a5eb-d7a06d566bce. {{(pid=87022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:23:48 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[83be3d57-2cd1-4199-a597-28f80555aa31]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f061b59-1967-44c2-be41-8277a4605a8c_pditqqmm {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:48 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f061b59-1967-44c2-be41-8277a4605a8c_pditqqmm Jul 08 01:23:48 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:49 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f061b59-1967-44c2-be41-8277a4605a8c_pditqqmm" returned: 0 in 0.835s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f061b59-1967-44c2-be41-8277a4605a8c_pditqqmm {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:49 devstack sudo[102152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f061b59-1967-44c2-be41-8277a4605a8c_pditqqmm Jul 08 01:23:49 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-101cccb2-7e51-400a-abcf-6863b00e5789 req-bfdc4895-df52-4872-9a3f-de14894e408b tempest-TestStampPattern-1012369784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-101cccb2-7e51-400a-abcf-6863b00e5789 req-bfdc4895-df52-4872-9a3f-de14894e408b tempest-TestStampPattern-1012369784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:50 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba97812b-8ffb-40d1-81ac-7a7b9be217e3]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-101cccb2-7e51-400a-abcf-6863b00e5789 req-bfdc4895-df52-4872-9a3f-de14894e408b tempest-TestStampPattern-1012369784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2004b538-a372-4bd4-baa0-29310313f7c7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:50 devstack sudo[102162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2004b538-a372-4bd4-baa0-29310313f7c7 Jul 08 01:23:50 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:50 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f061b59-1967-44c2-be41-8277a4605a8c_pditqqmm" returned: 1 in 1.106s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f061b59-1967-44c2-be41-8277a4605a8c_pditqqmm' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:23:50 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[12879d81-3b60-48c2-b2ed-9b833972d7e2]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f061b59-1967-44c2-be41-8277a4605a8c_oj1la0pgdevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:51 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f061b59-1967-44c2-be41-8277a4605a8c_oj1la0pgdevstack@QuobyteHD Jul 08 01:23:51 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:51 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-101cccb2-7e51-400a-abcf-6863b00e5789 req-bfdc4895-df52-4872-9a3f-de14894e408b tempest-TestStampPattern-1012369784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2004b538-a372-4bd4-baa0-29310313f7c7" returned: 0 in 1.504s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-101cccb2-7e51-400a-abcf-6863b00e5789 req-bfdc4895-df52-4872-9a3f-de14894e408b tempest-TestStampPattern-1012369784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.525s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:51 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-101cccb2-7e51-400a-abcf-6863b00e5789 req-bfdc4895-df52-4872-9a3f-de14894e408b tempest-TestStampPattern-1012369784 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d', 'name': 'volume-2004b538-a372-4bd4-baa0-29310313f7c7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a7fd9084-3d4a-44eb-ac33-74752d0ef860', 'enforce_multipath': True} {{(pid=87022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:23:51 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-101cccb2-7e51-400a-abcf-6863b00e5789 req-bfdc4895-df52-4872-9a3f-de14894e408b tempest-TestStampPattern-1012369784 None] attachment_update completed successfully. Jul 08 01:23:52 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f061b59-1967-44c2-be41-8277a4605a8c_oj1la0pgdevstack@QuobyteHD" returned: 0 in 1.302s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f061b59-1967-44c2-be41-8277a4605a8c_oj1la0pgdevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:52 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f061b59-1967-44c2-be41-8277a4605a8c_oj1la0pgdevstack@QuobyteHD Jul 08 01:23:52 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:52 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f061b59-1967-44c2-be41-8277a4605a8c_oj1la0pgdevstack@QuobyteHD" returned: 1 in 0.950s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f061b59-1967-44c2-be41-8277a4605a8c_oj1la0pgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:23:53 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] 3f061b59-1967-44c2-be41-8277a4605a8c was raw, converting to raw {{(pid=87022) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:23:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3f061b59-1967-44c2-be41-8277a4605a8c_oj1la0pgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:53 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3f061b59-1967-44c2-be41-8277a4605a8c_oj1la0pgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce Jul 08 01:23:53 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:54 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3f061b59-1967-44c2-be41-8277a4605a8c_oj1la0pgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce" returned: 0 in 1.132s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:54 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3f061b59-1967-44c2-be41-8277a4605a8c_oj1la0pgdevstack@QuobyteHD, size 0.00 MB, duration 1.13 sec, destination /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce {{(pid=87022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:23:54 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 01:23:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:54 devstack sudo[102565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce 1G Jul 08 01:23:54 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:55 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce 1G" returned: 0 in 1.018s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:55 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc109bf-5878-4948-a8e6-9c4ba074c27e]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:55 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce Jul 08 01:23:55 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:56 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce" returned: 0 in 1.440s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:56 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce Jul 08 01:23:56 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:57 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce" returned: 1 in 1.189s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:23:57 devstack cinder-volume[87022]: DEBUG cinder.volume.volume_utils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Downloaded image 3f061b59-1967-44c2-be41-8277a4605a8c ((None, [{'url': 'file:///opt/stack/data/glance/images/3f061b59-1967-44c2-be41-8277a4605a8c', 'metadata': {}}])) to volume 6cb15fcd-00da-4d10-a5eb-d7a06d566bce successfully. {{(pid=87022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:23:57 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Temporary image 3f061b59-1967-44c2-be41-8277a4605a8c for user 8fa2da82508b44bdb5823962187974bb is deleted. {{(pid=87022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:23:57 devstack cinder-volume[87022]: DEBUG cinder.volume.volume_utils [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Marking volume 6cb15fcd-00da-4d10-a5eb-d7a06d566bce as bootable. {{(pid=87022) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:23:57 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Copying metadata from image 3f061b59-1967-44c2-be41-8277a4605a8c to 6cb15fcd-00da-4d10-a5eb-d7a06d566bce. {{(pid=87022) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:23:57 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Creating volume glance metadata for volume 6cb15fcd-00da-4d10-a5eb-d7a06d566bce backed by image 3f061b59-1967-44c2-be41-8277a4605a8c with: {'image_id': '3f061b59-1967-44c2-be41-8277a4605a8c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1bf05b4be12a24bde09e6eed065f6474', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87022) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:23:57 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9f9686f-086a-46a8-9d04-90216a8dac77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce', 'volume_size': 1, 'image_id': '3f061b59-1967-44c2-be41-8277a4605a8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f061b59-1967-44c2-be41-8277a4605a8c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1bf05b4be12a24bde09e6eed065f6474', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2628981f13f44c789dab6971a2eac59b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '10ead684cb01159b8f05fe288c8d99a060063ba5182ae8fb2ba81eeded013746e659079b1f4c0558066971abd2261678868b46e440fb7acdf01f8e8c9351fd8c', 'id': '3f061b59-1967-44c2-be41-8277a4605a8c', 'created_at': datetime.datetime(2026, 7, 7, 23, 23, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 23, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f061b59-1967-44c2-be41-8277a4605a8c/file', 'properties': {}}, 'image_service': }' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cfc5eff-5ab0-45c5-a45c-d328e9f78a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:58 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Volume volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce (6cb15fcd-00da-4d10-a5eb-d7a06d566bce): created successfully Jul 08 01:23:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cfc5eff-5ab0-45c5-a45c-d328e9f78a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:58 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Flow 'volume_create_manager' (a32a9a85-7123-440a-8eec-5c4644a938d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:58 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-8105ba84-8c73-4f1d-bea6-2b6f9b2a478f tempest-VolumeImageDependencyTests-558441346 None] Created volume successfully. Jul 08 01:23:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b8928b40-fecf-40f7-b5f8-6e5d71c28805 tempest-VolumeImageDependencyTests-558441346 None] Acquiring lock "cinder-6cb15fcd-00da-4d10-a5eb-d7a06d566bce-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b8928b40-fecf-40f7-b5f8-6e5d71c28805 tempest-VolumeImageDependencyTests-558441346 None] Lock "cinder-6cb15fcd-00da-4d10-a5eb-d7a06d566bce-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:59 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b8928b40-fecf-40f7-b5f8-6e5d71c28805 tempest-VolumeImageDependencyTests-558441346 None] Acquiring lock "cinder-quobyte-6cb15fcd-00da-4d10-a5eb-d7a06d566bce" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:59 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b8928b40-fecf-40f7-b5f8-6e5d71c28805 tempest-VolumeImageDependencyTests-558441346 None] Lock "cinder-quobyte-6cb15fcd-00da-4d10-a5eb-d7a06d566bce" acquired by "delete_volume" :: waited 0.014s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:59 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[894944fa-408c-4ef2-b71b-f70054c6ac81]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b8928b40-fecf-40f7-b5f8-6e5d71c28805 tempest-VolumeImageDependencyTests-558441346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:59 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce Jul 08 01:23:59 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:59 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-2bc3b49f-ab3e-44b2-9014-f1135a62a7bc req-0cf5180b-f62b-42f8-aec1-64e445f73dd0 tempest-TestStampPattern-1012369784 None] Terminate volume connection completed successfully. Jul 08 01:23:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-2bc3b49f-ab3e-44b2-9014-f1135a62a7bc req-0cf5180b-f62b-42f8-aec1-64e445f73dd0 tempest-TestStampPattern-1012369784 None] Deleting attachment a7fd9084-3d4a-44eb-ac33-74752d0ef860. {{(pid=87022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:24:00 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b8928b40-fecf-40f7-b5f8-6e5d71c28805 tempest-VolumeImageDependencyTests-558441346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce" returned: 0 in 1.346s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b8928b40-fecf-40f7-b5f8-6e5d71c28805 tempest-VolumeImageDependencyTests-558441346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:00 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce Jul 08 01:24:00 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:01 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b8928b40-fecf-40f7-b5f8-6e5d71c28805 tempest-VolumeImageDependencyTests-558441346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce" returned: 1 in 0.918s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b8928b40-fecf-40f7-b5f8-6e5d71c28805 tempest-VolumeImageDependencyTests-558441346 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:24:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b8928b40-fecf-40f7-b5f8-6e5d71c28805 tempest-VolumeImageDependencyTests-558441346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:01 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce Jul 08 01:24:01 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:02 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b8928b40-fecf-40f7-b5f8-6e5d71c28805 tempest-VolumeImageDependencyTests-558441346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6cb15fcd-00da-4d10-a5eb-d7a06d566bce" returned: 0 in 0.939s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:02 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b8928b40-fecf-40f7-b5f8-6e5d71c28805 tempest-VolumeImageDependencyTests-558441346 None] Lock "cinder-quobyte-6cb15fcd-00da-4d10-a5eb-d7a06d566bce" released by "delete_volume" :: held 3.317s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:02 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-b8928b40-fecf-40f7-b5f8-6e5d71c28805 tempest-VolumeImageDependencyTests-558441346 None] Created reservations ['358f0655-ab0b-4519-a82c-2dc82216d568', 'd67d33b2-5159-4e59-8550-ed518e7a94ca', '9c05e536-d9a9-4d0b-90be-97e47e6a062d', '555514cd-3933-4509-93f1-3b27d15f3770'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b8928b40-fecf-40f7-b5f8-6e5d71c28805 tempest-VolumeImageDependencyTests-558441346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b8928b40-fecf-40f7-b5f8-6e5d71c28805 tempest-VolumeImageDependencyTests-558441346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b8928b40-fecf-40f7-b5f8-6e5d71c28805 tempest-VolumeImageDependencyTests-558441346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b8928b40-fecf-40f7-b5f8-6e5d71c28805 tempest-VolumeImageDependencyTests-558441346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b8928b40-fecf-40f7-b5f8-6e5d71c28805 tempest-VolumeImageDependencyTests-558441346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b8928b40-fecf-40f7-b5f8-6e5d71c28805 tempest-VolumeImageDependencyTests-558441346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:02 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:24:02 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:03 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b8928b40-fecf-40f7-b5f8-6e5d71c28805 tempest-VolumeImageDependencyTests-558441346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.332s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:03 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-b8928b40-fecf-40f7-b5f8-6e5d71c28805 tempest-VolumeImageDependencyTests-558441346 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:03 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-b8928b40-fecf-40f7-b5f8-6e5d71c28805 tempest-VolumeImageDependencyTests-558441346 None] Deleted volume successfully. Jul 08 01:24:03 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b8928b40-fecf-40f7-b5f8-6e5d71c28805 tempest-VolumeImageDependencyTests-558441346 None] Lock "cinder-6cb15fcd-00da-4d10-a5eb-d7a06d566bce-delete_volume" released by "delete_volume" :: held 5.039s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:11 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:24:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Flow 'volume_create_manager' (86ae8ca9-6c81-4b8e-b58b-b4c7bc36af4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db1b89b1-ed7e-47da-b5c6-326b6fe6dca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db1b89b1-ed7e-47da-b5c6-326b6fe6dca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-481668324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79ccc208-bf36-4707-8f6d-e90374828d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36cfabcba4ed45558c23f87507cefd5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:12Z,use_quota=True,user_id='a558c8f9bd3241028f01f5f7e5426350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (442e30b1-43ea-4a03-9be1-8ab2f89acb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (442e30b1-43ea-4a03-9be1-8ab2f89acb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab49eca6-d461-4e4f-a1e3-341b23bdc3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab49eca6-d461-4e4f-a1e3-341b23bdc3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79ccc208-bf36-4707-8f6d-e90374828d2e', 'volume_name': 'volume-79ccc208-bf36-4707-8f6d-e90374828d2e', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d10c523-6740-4a50-acf3-e57eddadb4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d10c523-6740-4a50-acf3-e57eddadb4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a10f1a-d8a0-4bf0-8676-86d1a8e857d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:11 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Volume 79ccc208-bf36-4707-8f6d-e90374828d2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79ccc208-bf36-4707-8f6d-e90374828d2e', 'volume_size': 1} Jul 08 01:24:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:11 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-481668324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79ccc208-bf36-4707-8f6d-e90374828d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36cfabcba4ed45558c23f87507cefd5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:12Z,use_quota=True,user_id='a558c8f9bd3241028f01f5f7e5426350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:24:11 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Creating volume 79ccc208-bf36-4707-8f6d-e90374828d2e {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:24:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:11 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:11 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:11 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:24:11 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:24:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-79ccc208-bf36-4707-8f6d-e90374828d2e 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:11 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-79ccc208-bf36-4707-8f6d-e90374828d2e 1073741824 Jul 08 01:24:11 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:13 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-79ccc208-bf36-4707-8f6d-e90374828d2e 1073741824" returned: 0 in 1.164s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-79ccc208-bf36-4707-8f6d-e90374828d2e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:13 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-79ccc208-bf36-4707-8f6d-e90374828d2e Jul 08 01:24:13 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Flow 'volume_create_manager' (aa40559c-9293-4b7a-b0fb-7ffdb2dbde8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8681b756-f631-4b75-9959-58d1e07de98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8681b756-f631-4b75-9959-58d1e07de98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1228577424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e672cf41-cff9-4f80-9518-00a6ad23f566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3816a91a9d74408e90c31a5e8defb5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:14Z,use_quota=True,user_id='31c8c313e74c4328b58fdaa9a2384f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194e4c50-e9f6-4620-b9e9-f299dff6939c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194e4c50-e9f6-4620-b9e9-f299dff6939c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc33e85-53f3-47bf-94b6-3223af3f797e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc33e85-53f3-47bf-94b6-3223af3f797e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e672cf41-cff9-4f80-9518-00a6ad23f566', 'volume_name': 'volume-e672cf41-cff9-4f80-9518-00a6ad23f566', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3524ae1d-773e-4989-8e61-799a4d4cc844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3524ae1d-773e-4989-8e61-799a4d4cc844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4517efe-85b6-459c-bf24-4da10dc38d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:13 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Volume e672cf41-cff9-4f80-9518-00a6ad23f566: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e672cf41-cff9-4f80-9518-00a6ad23f566', 'volume_size': 1} Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:13 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-79ccc208-bf36-4707-8f6d-e90374828d2e" returned: 0 in 0.704s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] <== create_volume: return (1920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.099s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1228577424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e672cf41-cff9-4f80-9518-00a6ad23f566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3816a91a9d74408e90c31a5e8defb5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:14Z,use_quota=True,user_id='31c8c313e74c4328b58fdaa9a2384f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Creating volume e672cf41-cff9-4f80-9518-00a6ad23f566 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:24:13 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:13 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566 1073741824 Jul 08 01:24:13 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a10f1a-d8a0-4bf0-8676-86d1a8e857d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79ccc208-bf36-4707-8f6d-e90374828d2e', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937c390e-e443-4f44-b5b1-3d405d402b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:13 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Volume volume-79ccc208-bf36-4707-8f6d-e90374828d2e (79ccc208-bf36-4707-8f6d-e90374828d2e): created successfully Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937c390e-e443-4f44-b5b1-3d405d402b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Flow 'volume_create_manager' (86ae8ca9-6c81-4b8e-b58b-b4c7bc36af4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:13 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-12de49a8-20ff-4d8d-8c09-3c09d1900854 tempest-ProjectReaderTests-2101034184 None] Created volume successfully. Jul 08 01:24:14 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566 1073741824" returned: 0 in 0.897s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:14 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566 Jul 08 01:24:14 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a5940e6d-59d6-403c-9ab5-d549675464d0 tempest-ProjectReaderTests-2101034184 None] Acquiring lock "cinder-79ccc208-bf36-4707-8f6d-e90374828d2e-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a5940e6d-59d6-403c-9ab5-d549675464d0 tempest-ProjectReaderTests-2101034184 None] Lock "cinder-79ccc208-bf36-4707-8f6d-e90374828d2e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a5940e6d-59d6-403c-9ab5-d549675464d0 tempest-ProjectReaderTests-2101034184 None] Acquiring lock "cinder-quobyte-79ccc208-bf36-4707-8f6d-e90374828d2e" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a5940e6d-59d6-403c-9ab5-d549675464d0 tempest-ProjectReaderTests-2101034184 None] Lock "cinder-quobyte-79ccc208-bf36-4707-8f6d-e90374828d2e" acquired by "delete_volume" :: waited 0.014s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:15 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ee25b5-c398-49ed-aff1-ef54913fe1c9]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a5940e6d-59d6-403c-9ab5-d549675464d0 tempest-ProjectReaderTests-2101034184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-79ccc208-bf36-4707-8f6d-e90374828d2e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7762cbf3-68d2-44a2-b502-0a297536e22e tempest-TestStampPattern-1012369784 None] Acquiring lock "cinder-2004b538-a372-4bd4-baa0-29310313f7c7-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7762cbf3-68d2-44a2-b502-0a297536e22e tempest-TestStampPattern-1012369784 None] Lock "cinder-2004b538-a372-4bd4-baa0-29310313f7c7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:15 devstack sudo[102803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-79ccc208-bf36-4707-8f6d-e90374828d2e Jul 08 01:24:15 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7762cbf3-68d2-44a2-b502-0a297536e22e tempest-TestStampPattern-1012369784 None] Acquiring lock "cinder-quobyte-2004b538-a372-4bd4-baa0-29310313f7c7" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7762cbf3-68d2-44a2-b502-0a297536e22e tempest-TestStampPattern-1012369784 None] Lock "cinder-quobyte-2004b538-a372-4bd4-baa0-29310313f7c7" acquired by "delete_volume" :: waited 0.017s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:15 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e9260d-951a-4e59-a5e9-817d0fa14a83]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7762cbf3-68d2-44a2-b502-0a297536e22e tempest-TestStampPattern-1012369784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2004b538-a372-4bd4-baa0-29310313f7c7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:15 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2004b538-a372-4bd4-baa0-29310313f7c7 Jul 08 01:24:15 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:15 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566" returned: 0 in 0.729s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:15 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:24:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4517efe-85b6-459c-bf24-4da10dc38d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e672cf41-cff9-4f80-9518-00a6ad23f566', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (543f82de-5498-43e9-b16b-867aa264d5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:15 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Volume volume-e672cf41-cff9-4f80-9518-00a6ad23f566 (e672cf41-cff9-4f80-9518-00a6ad23f566): created successfully Jul 08 01:24:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (543f82de-5498-43e9-b16b-867aa264d5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Flow 'volume_create_manager' (aa40559c-9293-4b7a-b0fb-7ffdb2dbde8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:15 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-87ee66e5-7d0d-41f5-9bad-858b51078d4b tempest-SnapshotDependencyTests-1669105759 None] Created volume successfully. Jul 08 01:24:16 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a5940e6d-59d6-403c-9ab5-d549675464d0 tempest-ProjectReaderTests-2101034184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-79ccc208-bf36-4707-8f6d-e90374828d2e" returned: 0 in 0.848s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a5940e6d-59d6-403c-9ab5-d549675464d0 tempest-ProjectReaderTests-2101034184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-79ccc208-bf36-4707-8f6d-e90374828d2e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a9dd1714-1848-4bd3-a399-b0a285a6f2c7 tempest-SnapshotDependencyTests-1669105759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a9dd1714-1848-4bd3-a399-b0a285a6f2c7 tempest-SnapshotDependencyTests-1669105759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:16 devstack sudo[102817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-79ccc208-bf36-4707-8f6d-e90374828d2e Jul 08 01:24:16 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-a9dd1714-1848-4bd3-a399-b0a285a6f2c7 tempest-SnapshotDependencyTests-1669105759 None] Creating offline snapshot 9db27264-53bf-4a2b-91be-464a757c0edb of volume e672cf41-cff9-4f80-9518-00a6ad23f566 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:24:16 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9357a2-d8e6-4078-870c-c86e52227118]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a9dd1714-1848-4bd3-a399-b0a285a6f2c7 tempest-SnapshotDependencyTests-1669105759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:16 devstack sudo[102820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566 Jul 08 01:24:16 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:16 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7762cbf3-68d2-44a2-b502-0a297536e22e tempest-TestStampPattern-1012369784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2004b538-a372-4bd4-baa0-29310313f7c7" returned: 0 in 0.865s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7762cbf3-68d2-44a2-b502-0a297536e22e tempest-TestStampPattern-1012369784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2004b538-a372-4bd4-baa0-29310313f7c7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:16 devstack sudo[102824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2004b538-a372-4bd4-baa0-29310313f7c7 Jul 08 01:24:16 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:16 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a5940e6d-59d6-403c-9ab5-d549675464d0 tempest-ProjectReaderTests-2101034184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-79ccc208-bf36-4707-8f6d-e90374828d2e" returned: 0 in 0.716s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a5940e6d-59d6-403c-9ab5-d549675464d0 tempest-ProjectReaderTests-2101034184 None] Lock "cinder-quobyte-79ccc208-bf36-4707-8f6d-e90374828d2e" released by "delete_volume" :: held 1.615s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:16 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-a5940e6d-59d6-403c-9ab5-d549675464d0 tempest-ProjectReaderTests-2101034184 None] Created reservations ['2791552c-171a-4871-bc42-64b60d933611', 'a6086a1f-3833-494f-8ae2-02d3e37dd86f', '380f5d7d-87fe-4180-8309-ad95f45add75', '767b9e47-0acb-47c3-9f98-f7b2b2670a3f'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a5940e6d-59d6-403c-9ab5-d549675464d0 tempest-ProjectReaderTests-2101034184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a5940e6d-59d6-403c-9ab5-d549675464d0 tempest-ProjectReaderTests-2101034184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a5940e6d-59d6-403c-9ab5-d549675464d0 tempest-ProjectReaderTests-2101034184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a5940e6d-59d6-403c-9ab5-d549675464d0 tempest-ProjectReaderTests-2101034184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a5940e6d-59d6-403c-9ab5-d549675464d0 tempest-ProjectReaderTests-2101034184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a5940e6d-59d6-403c-9ab5-d549675464d0 tempest-ProjectReaderTests-2101034184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:16 devstack sudo[102831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:24:16 devstack sudo[102831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:16 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a9dd1714-1848-4bd3-a399-b0a285a6f2c7 tempest-SnapshotDependencyTests-1669105759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566" returned: 0 in 0.866s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a9dd1714-1848-4bd3-a399-b0a285a6f2c7 tempest-SnapshotDependencyTests-1669105759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566.9db27264-53bf-4a2b-91be-464a757c0edb 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:16 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566.9db27264-53bf-4a2b-91be-464a757c0edb 1G Jul 08 01:24:16 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:17 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7762cbf3-68d2-44a2-b502-0a297536e22e tempest-TestStampPattern-1012369784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-2004b538-a372-4bd4-baa0-29310313f7c7" returned: 0 in 0.740s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:17 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7762cbf3-68d2-44a2-b502-0a297536e22e tempest-TestStampPattern-1012369784 None] Lock "cinder-quobyte-2004b538-a372-4bd4-baa0-29310313f7c7" released by "delete_volume" :: held 1.646s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:17 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-7762cbf3-68d2-44a2-b502-0a297536e22e tempest-TestStampPattern-1012369784 None] Created reservations ['f1164c0a-a614-4fc7-b9de-04ee8c2a0349', 'ee8813f7-b057-4230-8389-e05ab98cde9d', '5f4aebfa-75e7-41d9-93ad-38b78ad2151b', 'a055dc7a-16f8-4de5-b9f9-12cd52a349d0'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7762cbf3-68d2-44a2-b502-0a297536e22e tempest-TestStampPattern-1012369784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7762cbf3-68d2-44a2-b502-0a297536e22e tempest-TestStampPattern-1012369784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7762cbf3-68d2-44a2-b502-0a297536e22e tempest-TestStampPattern-1012369784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7762cbf3-68d2-44a2-b502-0a297536e22e tempest-TestStampPattern-1012369784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7762cbf3-68d2-44a2-b502-0a297536e22e tempest-TestStampPattern-1012369784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7762cbf3-68d2-44a2-b502-0a297536e22e tempest-TestStampPattern-1012369784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:17 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:24:17 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:17 devstack sudo[102831]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a5940e6d-59d6-403c-9ab5-d549675464d0 tempest-ProjectReaderTests-2101034184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.042s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:17 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-a5940e6d-59d6-403c-9ab5-d549675464d0 tempest-ProjectReaderTests-2101034184 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:17 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-a5940e6d-59d6-403c-9ab5-d549675464d0 tempest-ProjectReaderTests-2101034184 None] Deleted volume successfully. Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a5940e6d-59d6-403c-9ab5-d549675464d0 tempest-ProjectReaderTests-2101034184 None] Lock "cinder-79ccc208-bf36-4707-8f6d-e90374828d2e-delete_volume" released by "delete_volume" :: held 2.950s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Flow 'volume_create_manager' (22ca73e3-df94-4b7e-ba46-ce7bb338417d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897249af-8a4a-44c9-b27e-484ffe7e5756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897249af-8a4a-44c9-b27e-484ffe7e5756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1184010278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50898f6-5436-43ca-af23-ffe0f62b8a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36cfabcba4ed45558c23f87507cefd5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:18Z,use_quota=True,user_id='a558c8f9bd3241028f01f5f7e5426350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad64fa9-9e4f-4893-a18d-10d22b0fde02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:18 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad64fa9-9e4f-4893-a18d-10d22b0fde02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a47285-6e79-4c10-b185-65704cd0b1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a47285-6e79-4c10-b185-65704cd0b1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a50898f6-5436-43ca-af23-ffe0f62b8a46', 'volume_name': 'volume-a50898f6-5436-43ca-af23-ffe0f62b8a46', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f69b7f-b72c-480e-a046-a5433d2a3232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f69b7f-b72c-480e-a046-a5433d2a3232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc3e1b2-dfff-422b-8502-ec83db2925a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:18 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Volume a50898f6-5436-43ca-af23-ffe0f62b8a46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a50898f6-5436-43ca-af23-ffe0f62b8a46', 'volume_size': 1} Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a9dd1714-1848-4bd3-a399-b0a285a6f2c7 tempest-SnapshotDependencyTests-1669105759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566.9db27264-53bf-4a2b-91be-464a757c0edb 1G" returned: 0 in 1.231s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a9dd1714-1848-4bd3-a399-b0a285a6f2c7 tempest-SnapshotDependencyTests-1669105759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e672cf41-cff9-4f80-9518-00a6ad23f566 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566.9db27264-53bf-4a2b-91be-464a757c0edb {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:18 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7762cbf3-68d2-44a2-b502-0a297536e22e tempest-TestStampPattern-1012369784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.058s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-7762cbf3-68d2-44a2-b502-0a297536e22e tempest-TestStampPattern-1012369784 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:18 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-7762cbf3-68d2-44a2-b502-0a297536e22e tempest-TestStampPattern-1012369784 None] Deleted volume successfully. Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-54f828f7-7d84-4f9c-a158-6e3adf247884 tempest-TestStampPattern-1012369784 None] Acquiring lock "cinder-f01bcfd7-c664-4c0c-ade4-be0cb60b4f16-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:18 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e672cf41-cff9-4f80-9518-00a6ad23f566 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566.9db27264-53bf-4a2b-91be-464a757c0edb Jul 08 01:24:18 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-54f828f7-7d84-4f9c-a158-6e3adf247884 tempest-TestStampPattern-1012369784 None] Lock "cinder-f01bcfd7-c664-4c0c-ade4-be0cb60b4f16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-54f828f7-7d84-4f9c-a158-6e3adf247884 tempest-TestStampPattern-1012369784 None] Acquiring lock "cinder-quobyte-cfcb1279-1adf-460f-8a50-ee507a6fb22c" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7762cbf3-68d2-44a2-b502-0a297536e22e tempest-TestStampPattern-1012369784 None] Lock "cinder-2004b538-a372-4bd4-baa0-29310313f7c7-delete_volume" released by "delete_volume" :: held 2.949s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-54f828f7-7d84-4f9c-a158-6e3adf247884 tempest-TestStampPattern-1012369784 None] Lock "cinder-quobyte-cfcb1279-1adf-460f-8a50-ee507a6fb22c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-54f828f7-7d84-4f9c-a158-6e3adf247884 tempest-TestStampPattern-1012369784 None] Acquiring lock "cinder-quobyte-f01bcfd7-c664-4c0c-ade4-be0cb60b4f16" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-54f828f7-7d84-4f9c-a158-6e3adf247884 tempest-TestStampPattern-1012369784 None] Lock "cinder-quobyte-f01bcfd7-c664-4c0c-ade4-be0cb60b4f16" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-54f828f7-7d84-4f9c-a158-6e3adf247884 tempest-TestStampPattern-1012369784 None] Deleting offline snapshot f01bcfd7-c664-4c0c-ade4-be0cb60b4f16 of volume cfcb1279-1adf-460f-8a50-ee507a6fb22c {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-54f828f7-7d84-4f9c-a158-6e3adf247884 tempest-TestStampPattern-1012369784 None] snapshot_file for this snap is: volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.f01bcfd7-c664-4c0c-ade4-be0cb60b4f16 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b714959-bddd-42f5-a70d-2e32830b6573]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-54f828f7-7d84-4f9c-a158-6e3adf247884 tempest-TestStampPattern-1012369784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.f01bcfd7-c664-4c0c-ade4-be0cb60b4f16 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:18 devstack sudo[102846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.f01bcfd7-c664-4c0c-ade4-be0cb60b4f16 Jul 08 01:24:18 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:18 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a9dd1714-1848-4bd3-a399-b0a285a6f2c7 tempest-SnapshotDependencyTests-1669105759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e672cf41-cff9-4f80-9518-00a6ad23f566 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566.9db27264-53bf-4a2b-91be-464a757c0edb" returned: 0 in 0.793s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:18 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-a9dd1714-1848-4bd3-a399-b0a285a6f2c7 tempest-SnapshotDependencyTests-1669105759 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566.9db27264-53bf-4a2b-91be-464a757c0edb is being set with open permissions: ugo+rw Jul 08 01:24:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a9dd1714-1848-4bd3-a399-b0a285a6f2c7 tempest-SnapshotDependencyTests-1669105759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566.9db27264-53bf-4a2b-91be-464a757c0edb {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:19 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566.9db27264-53bf-4a2b-91be-464a757c0edb Jul 08 01:24:19 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:19 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-54f828f7-7d84-4f9c-a158-6e3adf247884 tempest-TestStampPattern-1012369784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.f01bcfd7-c664-4c0c-ade4-be0cb60b4f16" returned: 0 in 0.852s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-54f828f7-7d84-4f9c-a158-6e3adf247884 tempest-TestStampPattern-1012369784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:24:19 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7215ea1-6230-4841-9b4a-efa5bced876e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-54f828f7-7d84-4f9c-a158-6e3adf247884 tempest-TestStampPattern-1012369784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:19 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c Jul 08 01:24:19 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:19 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a9dd1714-1848-4bd3-a399-b0a285a6f2c7 tempest-SnapshotDependencyTests-1669105759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566.9db27264-53bf-4a2b-91be-464a757c0edb" returned: 0 in 0.720s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a9dd1714-1848-4bd3-a399-b0a285a6f2c7 tempest-SnapshotDependencyTests-1669105759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:19 devstack sudo[102859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566.info Jul 08 01:24:19 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:20 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-54f828f7-7d84-4f9c-a158-6e3adf247884 tempest-TestStampPattern-1012369784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c" returned: 0 in 0.817s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-54f828f7-7d84-4f9c-a158-6e3adf247884 tempest-TestStampPattern-1012369784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.f01bcfd7-c664-4c0c-ade4-be0cb60b4f16 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:20 devstack sudo[102864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.f01bcfd7-c664-4c0c-ade4-be0cb60b4f16 Jul 08 01:24:20 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:20 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a9dd1714-1848-4bd3-a399-b0a285a6f2c7 tempest-SnapshotDependencyTests-1669105759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566.info" returned: 0 in 0.772s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:20 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-a9dd1714-1848-4bd3-a399-b0a285a6f2c7 tempest-SnapshotDependencyTests-1669105759 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566.info is being set with open permissions: ugo+rw Jul 08 01:24:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a9dd1714-1848-4bd3-a399-b0a285a6f2c7 tempest-SnapshotDependencyTests-1669105759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:20 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566.info Jul 08 01:24:20 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:21 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-54f828f7-7d84-4f9c-a158-6e3adf247884 tempest-TestStampPattern-1012369784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.f01bcfd7-c664-4c0c-ade4-be0cb60b4f16" returned: 0 in 0.988s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-54f828f7-7d84-4f9c-a158-6e3adf247884 tempest-TestStampPattern-1012369784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.f01bcfd7-c664-4c0c-ade4-be0cb60b4f16 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:21 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.f01bcfd7-c664-4c0c-ade4-be0cb60b4f16 Jul 08 01:24:21 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:21 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a9dd1714-1848-4bd3-a399-b0a285a6f2c7 tempest-SnapshotDependencyTests-1669105759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566.info" returned: 0 in 0.845s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a9dd1714-1848-4bd3-a399-b0a285a6f2c7 tempest-SnapshotDependencyTests-1669105759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.338s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.207s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1184010278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50898f6-5436-43ca-af23-ffe0f62b8a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36cfabcba4ed45558c23f87507cefd5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:18Z,use_quota=True,user_id='a558c8f9bd3241028f01f5f7e5426350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:24:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Creating volume a50898f6-5436-43ca-af23-ffe0f62b8a46 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:24:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:24:21 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:24:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a50898f6-5436-43ca-af23-ffe0f62b8a46 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:21 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a50898f6-5436-43ca-af23-ffe0f62b8a46 1073741824 Jul 08 01:24:21 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:21 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-a9dd1714-1848-4bd3-a399-b0a285a6f2c7 tempest-SnapshotDependencyTests-1669105759 None] Create snapshot completed successfully Jul 08 01:24:21 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-54f828f7-7d84-4f9c-a158-6e3adf247884 tempest-TestStampPattern-1012369784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c.f01bcfd7-c664-4c0c-ade4-be0cb60b4f16" returned: 0 in 0.797s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:21 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-54f828f7-7d84-4f9c-a158-6e3adf247884 tempest-TestStampPattern-1012369784 None] Lock "cinder-quobyte-f01bcfd7-c664-4c0c-ade4-be0cb60b4f16" released by "_delete_snapshot" :: held 3.558s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:21 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-54f828f7-7d84-4f9c-a158-6e3adf247884 tempest-TestStampPattern-1012369784 None] Lock "cinder-quobyte-cfcb1279-1adf-460f-8a50-ee507a6fb22c" released by "delete_snapshot" :: held 3.583s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:21 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-54f828f7-7d84-4f9c-a158-6e3adf247884 tempest-TestStampPattern-1012369784 None] Created reservations ['d0679767-607f-42fb-bcb8-536963b126b0', '176ed38a-9615-44c3-b096-90f84aa915d3', '45dd2bfa-ff3a-4a5f-8a42-110be64ba72e', '78dc616d-57ca-4aa1-a9e7-a5397f101502'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:21 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-54f828f7-7d84-4f9c-a158-6e3adf247884 tempest-TestStampPattern-1012369784 None] Delete snapshot completed successfully. Jul 08 01:24:21 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-54f828f7-7d84-4f9c-a158-6e3adf247884 tempest-TestStampPattern-1012369784 None] Lock "cinder-f01bcfd7-c664-4c0c-ade4-be0cb60b4f16-delete_snapshot" released by "delete_snapshot" :: held 3.737s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:22 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a50898f6-5436-43ca-af23-ffe0f62b8a46 1073741824" returned: 0 in 0.885s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a50898f6-5436-43ca-af23-ffe0f62b8a46 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:22 devstack sudo[102890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a50898f6-5436-43ca-af23-ffe0f62b8a46 Jul 08 01:24:22 devstack sudo[102890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Flow 'volume_create_manager' (9b8d675f-13f7-445d-b6e1-952dea3a1b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bfe3d12-a51c-403e-8fc0-9a4427c973c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bfe3d12-a51c-403e-8fc0-9a4427c973c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c4f9aa1-0044-44fe-928f-da10b78ec587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3816a91a9d74408e90c31a5e8defb5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9db27264-53bf-4a2b-91be-464a757c0edb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:23Z,use_quota=True,user_id='31c8c313e74c4328b58fdaa9a2384f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3187cb4-4222-413b-a309-75d87d93b39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3187cb4-4222-413b-a309-75d87d93b39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b26374a-8f8a-4329-bcdf-372a2d7e636e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b26374a-8f8a-4329-bcdf-372a2d7e636e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5c4f9aa1-0044-44fe-928f-da10b78ec587', 'volume_name': 'volume-5c4f9aa1-0044-44fe-928f-da10b78ec587', 'volume_size': 1, 'snapshot_id': '9db27264-53bf-4a2b-91be-464a757c0edb'}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18dfe880-fc16-487d-8154-5c207738bf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18dfe880-fc16-487d-8154-5c207738bf6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b37dcc17-dc90-4896-8651-651f52e86041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:23 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Volume 5c4f9aa1-0044-44fe-928f-da10b78ec587: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5c4f9aa1-0044-44fe-928f-da10b78ec587', 'volume_size': 1, 'snapshot_id': '9db27264-53bf-4a2b-91be-464a757c0edb'} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:23 devstack sudo[102890]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a50898f6-5436-43ca-af23-ffe0f62b8a46" returned: 0 in 0.875s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.017s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Acquiring lock "cinder-quobyte-9db27264-53bf-4a2b-91be-464a757c0edb-5c4f9aa1-0044-44fe-928f-da10b78ec587" by "_create_volume_from_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc3e1b2-dfff-422b-8502-ec83db2925a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a50898f6-5436-43ca-af23-ffe0f62b8a46', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1bc8eb0-7f62-44ce-929b-51bb86cb28f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Lock "cinder-quobyte-9db27264-53bf-4a2b-91be-464a757c0edb-5c4f9aa1-0044-44fe-928f-da10b78ec587" acquired by "_create_volume_from_snapshot" :: waited 0.068s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Creating volume 5c4f9aa1-0044-44fe-928f-da10b78ec587 from snapshot 9db27264-53bf-4a2b-91be-464a757c0edb {{(pid=87022) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Acquiring lock "cinder-quobyte-5c4f9aa1-0044-44fe-928f-da10b78ec587" by "_copy_volume_from_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:23 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Volume volume-a50898f6-5436-43ca-af23-ffe0f62b8a46 (a50898f6-5436-43ca-af23-ffe0f62b8a46): created successfully Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1bc8eb0-7f62-44ce-929b-51bb86cb28f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Flow 'volume_create_manager' (22ca73e3-df94-4b7e-ba46-ce7bb338417d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Lock "cinder-quobyte-5c4f9aa1-0044-44fe-928f-da10b78ec587" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] snapshot: 9db27264-53bf-4a2b-91be-464a757c0edb, volume: 5c4f9aa1-0044-44fe-928f-da10b78ec587, {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:24:23 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-f4d33b3b-c68a-4f75-9d12-f5b2500a30b6 tempest-ProjectReaderTests-2101034184 None] Created volume successfully. Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[5672f0c8-926a-40a0-a315-a135a62a5313]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566.9db27264-53bf-4a2b-91be-464a757c0edb {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:23 devstack sudo[102898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566.9db27264-53bf-4a2b-91be-464a757c0edb Jul 08 01:24:23 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:24 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566.9db27264-53bf-4a2b-91be-464a757c0edb" returned: 0 in 0.902s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e672cf41-cff9-4f80-9518-00a6ad23f566(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:24:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] will copy from snapshot at /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566 {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:24:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Creating direct copy from snapshot {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:24:24 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca774917-7939-42d2-80cf-2218d92b398c]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:24 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566 Jul 08 01:24:24 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f2d84fc5-c9f6-4f73-b196-61bf058d4c51 tempest-ProjectReaderTests-2101034184 None] Acquiring lock "cinder-a50898f6-5436-43ca-af23-ffe0f62b8a46-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f2d84fc5-c9f6-4f73-b196-61bf058d4c51 tempest-ProjectReaderTests-2101034184 None] Lock "cinder-a50898f6-5436-43ca-af23-ffe0f62b8a46-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:24 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:UPDATE=116,cinder:SELECT=97,cinder:INSERT=36,cinder:DELETE=8 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:24:24 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:DELETE=10,cinder:SELECT=94,cinder:UPDATE=100,cinder:INSERT=34 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:24:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f2d84fc5-c9f6-4f73-b196-61bf058d4c51 tempest-ProjectReaderTests-2101034184 None] Acquiring lock "cinder-quobyte-a50898f6-5436-43ca-af23-ffe0f62b8a46" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f2d84fc5-c9f6-4f73-b196-61bf058d4c51 tempest-ProjectReaderTests-2101034184 None] Lock "cinder-quobyte-a50898f6-5436-43ca-af23-ffe0f62b8a46" acquired by "delete_volume" :: waited 0.032s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:24 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77a4bbb-b76c-43d9-9b0b-d78bf3da2cd7]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f2d84fc5-c9f6-4f73-b196-61bf058d4c51 tempest-ProjectReaderTests-2101034184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a50898f6-5436-43ca-af23-ffe0f62b8a46 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:24 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a50898f6-5436-43ca-af23-ffe0f62b8a46 Jul 08 01:24:24 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:25 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566" returned: 0 in 1.016s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:25 devstack cinder-volume[87022]: DEBUG cinder.utils [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Path /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c4f9aa1-0044-44fe-928f-da10b78ec587 not found in is_blk_device check {{(pid=87022) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:24:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c4f9aa1-0044-44fe-928f-da10b78ec587 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:25 devstack sudo[102917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c4f9aa1-0044-44fe-928f-da10b78ec587 Jul 08 01:24:25 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:25 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f2d84fc5-c9f6-4f73-b196-61bf058d4c51 tempest-ProjectReaderTests-2101034184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a50898f6-5436-43ca-af23-ffe0f62b8a46" returned: 0 in 1.174s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f2d84fc5-c9f6-4f73-b196-61bf058d4c51 tempest-ProjectReaderTests-2101034184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a50898f6-5436-43ca-af23-ffe0f62b8a46 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:25 devstack sudo[102937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a50898f6-5436-43ca-af23-ffe0f62b8a46 Jul 08 01:24:25 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:27 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f2d84fc5-c9f6-4f73-b196-61bf058d4c51 tempest-ProjectReaderTests-2101034184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a50898f6-5436-43ca-af23-ffe0f62b8a46" returned: 0 in 1.515s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f2d84fc5-c9f6-4f73-b196-61bf058d4c51 tempest-ProjectReaderTests-2101034184 None] Lock "cinder-quobyte-a50898f6-5436-43ca-af23-ffe0f62b8a46" released by "delete_volume" :: held 2.775s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:27 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-f2d84fc5-c9f6-4f73-b196-61bf058d4c51 tempest-ProjectReaderTests-2101034184 None] Created reservations ['f5d0fa6e-5480-4340-af9e-ea8d97f69924', 'c68e6710-e8b5-4b00-90d3-2643297ec524', '9dc368d6-2006-46f8-a1db-fde99d3ca0c7', 'd72626f9-4b13-46f3-ae30-3c2b6a584e12'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f2d84fc5-c9f6-4f73-b196-61bf058d4c51 tempest-ProjectReaderTests-2101034184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f2d84fc5-c9f6-4f73-b196-61bf058d4c51 tempest-ProjectReaderTests-2101034184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f2d84fc5-c9f6-4f73-b196-61bf058d4c51 tempest-ProjectReaderTests-2101034184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f2d84fc5-c9f6-4f73-b196-61bf058d4c51 tempest-ProjectReaderTests-2101034184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f2d84fc5-c9f6-4f73-b196-61bf058d4c51 tempest-ProjectReaderTests-2101034184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f2d84fc5-c9f6-4f73-b196-61bf058d4c51 tempest-ProjectReaderTests-2101034184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:28 devstack sudo[102971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:24:28 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:28 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-286f3295-6b5a-49a8-91d1-971aa53c144b req-c9e83698-a5cf-413a-be30-7fce478acaf9 tempest-TestShelveInstance-205099010 None] Terminate volume connection completed successfully. Jul 08 01:24:28 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-286f3295-6b5a-49a8-91d1-971aa53c144b req-c9e83698-a5cf-413a-be30-7fce478acaf9 tempest-TestShelveInstance-205099010 None] Deleting attachment 603d5b40-a4e3-4543-bd74-e567b5bc4cb9. {{(pid=87022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:24:29 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f2d84fc5-c9f6-4f73-b196-61bf058d4c51 tempest-ProjectReaderTests-2101034184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 2.033s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:30 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-f2d84fc5-c9f6-4f73-b196-61bf058d4c51 tempest-ProjectReaderTests-2101034184 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:30 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-f2d84fc5-c9f6-4f73-b196-61bf058d4c51 tempest-ProjectReaderTests-2101034184 None] Deleted volume successfully. Jul 08 01:24:30 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f2d84fc5-c9f6-4f73-b196-61bf058d4c51 tempest-ProjectReaderTests-2101034184 None] Lock "cinder-a50898f6-5436-43ca-af23-ffe0f62b8a46-delete_volume" released by "delete_volume" :: held 5.491s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:32 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c4f9aa1-0044-44fe-928f-da10b78ec587" returned: 0 in 7.529s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:32 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd0143b-8f83-4110-8984-9e2c52267940]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:33 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566 Jul 08 01:24:33 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:34 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566" returned: 0 in 1.128s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:34 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Image conversion details: src /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566, size 1024.00 MB, duration 7.53 sec, destination /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c4f9aa1-0044-44fe-928f-da10b78ec587 {{(pid=87022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:24:34 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Converted 1024.00 MB image at 135.99 MB/s Jul 08 01:24:34 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c4f9aa1-0044-44fe-928f-da10b78ec587 is being set with open permissions: ugo+rw Jul 08 01:24:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c4f9aa1-0044-44fe-928f-da10b78ec587 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:34 devstack sudo[102982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c4f9aa1-0044-44fe-928f-da10b78ec587 Jul 08 01:24:34 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:34 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-96685e7c-722d-4911-a708-c47e66314832 tempest-TestStampPattern-1012369784 None] Acquiring lock "cinder-cfcb1279-1adf-460f-8a50-ee507a6fb22c-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:34 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-96685e7c-722d-4911-a708-c47e66314832 tempest-TestStampPattern-1012369784 None] Lock "cinder-cfcb1279-1adf-460f-8a50-ee507a6fb22c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:34 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-96685e7c-722d-4911-a708-c47e66314832 tempest-TestStampPattern-1012369784 None] Acquiring lock "cinder-quobyte-cfcb1279-1adf-460f-8a50-ee507a6fb22c" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:34 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-96685e7c-722d-4911-a708-c47e66314832 tempest-TestStampPattern-1012369784 None] Lock "cinder-quobyte-cfcb1279-1adf-460f-8a50-ee507a6fb22c" acquired by "delete_volume" :: waited 0.017s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:34 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[832fda79-44cf-492c-a12d-90a4c36866cf]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-96685e7c-722d-4911-a708-c47e66314832 tempest-TestStampPattern-1012369784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:34 devstack sudo[102986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c Jul 08 01:24:34 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:34 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c4f9aa1-0044-44fe-928f-da10b78ec587" returned: 0 in 0.769s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:34 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Lock "cinder-quobyte-5c4f9aa1-0044-44fe-928f-da10b78ec587" released by "_copy_volume_from_snapshot" :: held 11.501s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:34 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Lock "cinder-quobyte-9db27264-53bf-4a2b-91be-464a757c0edb-5c4f9aa1-0044-44fe-928f-da10b78ec587" released by "_create_volume_from_snapshot" :: held 11.573s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.643s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:34 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b37dcc17-dc90-4896-8651-651f52e86041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c4f9aa1-0044-44fe-928f-da10b78ec587', 'volume_size': 1, 'snapshot_id': '9db27264-53bf-4a2b-91be-464a757c0edb'}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:34 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09522fb8-72b5-42bd-9b41-e1c5f02a16ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:34 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Volume volume-5c4f9aa1-0044-44fe-928f-da10b78ec587 (5c4f9aa1-0044-44fe-928f-da10b78ec587): created successfully Jul 08 01:24:34 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09522fb8-72b5-42bd-9b41-e1c5f02a16ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:34 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Flow 'volume_create_manager' (9b8d675f-13f7-445d-b6e1-952dea3a1b47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:34 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-5f4cf3d4-82c0-47d4-a508-18c326447843 tempest-SnapshotDependencyTests-1669105759 None] Created volume successfully. Jul 08 01:24:35 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-96685e7c-722d-4911-a708-c47e66314832 tempest-TestStampPattern-1012369784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c" returned: 0 in 0.787s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-96685e7c-722d-4911-a708-c47e66314832 tempest-TestStampPattern-1012369784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:35 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c Jul 08 01:24:35 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-38d0caa3-14e5-405b-a551-c09c28f2bc65 tempest-SnapshotDependencyTests-1669105759 None] Acquiring lock "cinder-9db27264-53bf-4a2b-91be-464a757c0edb-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-38d0caa3-14e5-405b-a551-c09c28f2bc65 tempest-SnapshotDependencyTests-1669105759 None] Lock "cinder-9db27264-53bf-4a2b-91be-464a757c0edb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-38d0caa3-14e5-405b-a551-c09c28f2bc65 tempest-SnapshotDependencyTests-1669105759 None] Acquiring lock "cinder-quobyte-e672cf41-cff9-4f80-9518-00a6ad23f566" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-38d0caa3-14e5-405b-a551-c09c28f2bc65 tempest-SnapshotDependencyTests-1669105759 None] Lock "cinder-quobyte-e672cf41-cff9-4f80-9518-00a6ad23f566" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-38d0caa3-14e5-405b-a551-c09c28f2bc65 tempest-SnapshotDependencyTests-1669105759 None] Acquiring lock "cinder-quobyte-9db27264-53bf-4a2b-91be-464a757c0edb" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-38d0caa3-14e5-405b-a551-c09c28f2bc65 tempest-SnapshotDependencyTests-1669105759 None] Lock "cinder-quobyte-9db27264-53bf-4a2b-91be-464a757c0edb" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:35 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-38d0caa3-14e5-405b-a551-c09c28f2bc65 tempest-SnapshotDependencyTests-1669105759 None] Deleting offline snapshot 9db27264-53bf-4a2b-91be-464a757c0edb of volume e672cf41-cff9-4f80-9518-00a6ad23f566 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:24:35 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-38d0caa3-14e5-405b-a551-c09c28f2bc65 tempest-SnapshotDependencyTests-1669105759 None] snapshot_file for this snap is: volume-e672cf41-cff9-4f80-9518-00a6ad23f566.9db27264-53bf-4a2b-91be-464a757c0edb {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:24:35 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[5815ba13-bd96-4521-bdaa-07dd0c6d4d2b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-38d0caa3-14e5-405b-a551-c09c28f2bc65 tempest-SnapshotDependencyTests-1669105759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566.9db27264-53bf-4a2b-91be-464a757c0edb {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:35 devstack sudo[102996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566.9db27264-53bf-4a2b-91be-464a757c0edb Jul 08 01:24:35 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:35 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-96685e7c-722d-4911-a708-c47e66314832 tempest-TestStampPattern-1012369784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cfcb1279-1adf-460f-8a50-ee507a6fb22c" returned: 0 in 0.651s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:36 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-96685e7c-722d-4911-a708-c47e66314832 tempest-TestStampPattern-1012369784 None] Lock "cinder-quobyte-cfcb1279-1adf-460f-8a50-ee507a6fb22c" released by "delete_volume" :: held 1.512s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:36 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-96685e7c-722d-4911-a708-c47e66314832 tempest-TestStampPattern-1012369784 None] Created reservations ['1e909477-2324-4411-a6e5-6f2316cb42a9', '0cfe331f-105f-4b10-8d42-aff9bb901577', 'daaf2ea1-c1e8-45ac-8744-fd7aa19b5d1e', '1afd9f75-5637-4d08-8dc6-1df61560a72e'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-96685e7c-722d-4911-a708-c47e66314832 tempest-TestStampPattern-1012369784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-96685e7c-722d-4911-a708-c47e66314832 tempest-TestStampPattern-1012369784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-96685e7c-722d-4911-a708-c47e66314832 tempest-TestStampPattern-1012369784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-96685e7c-722d-4911-a708-c47e66314832 tempest-TestStampPattern-1012369784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-96685e7c-722d-4911-a708-c47e66314832 tempest-TestStampPattern-1012369784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-96685e7c-722d-4911-a708-c47e66314832 tempest-TestStampPattern-1012369784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:36 devstack sudo[102999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:24:36 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-3fe74368-c9e6-4ab4-983b-40687e589622 req-e8afb40d-ee32-4212-bd2f-8a03b2c10797 tempest-TestShelveInstance-205099010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-3fe74368-c9e6-4ab4-983b-40687e589622 req-e8afb40d-ee32-4212-bd2f-8a03b2c10797 tempest-TestShelveInstance-205099010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:36 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-38d0caa3-14e5-405b-a551-c09c28f2bc65 tempest-SnapshotDependencyTests-1669105759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566.9db27264-53bf-4a2b-91be-464a757c0edb" returned: 0 in 0.894s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-38d0caa3-14e5-405b-a551-c09c28f2bc65 tempest-SnapshotDependencyTests-1669105759 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e672cf41-cff9-4f80-9518-00a6ad23f566(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:24:36 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ae37b1-ad18-4a8f-b5af-f9dfaba2610a]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-3fe74368-c9e6-4ab4-983b-40687e589622 req-e8afb40d-ee32-4212-bd2f-8a03b2c10797 tempest-TestShelveInstance-205099010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:36 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bb897f-243c-4bfa-bf33-5aeb7a975958]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-38d0caa3-14e5-405b-a551-c09c28f2bc65 tempest-SnapshotDependencyTests-1669105759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:36 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566 Jul 08 01:24:36 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:36 devstack sudo[103012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4 Jul 08 01:24:36 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:36 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-96685e7c-722d-4911-a708-c47e66314832 tempest-TestStampPattern-1012369784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.832s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:36 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-96685e7c-722d-4911-a708-c47e66314832 tempest-TestStampPattern-1012369784 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:37 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-96685e7c-722d-4911-a708-c47e66314832 tempest-TestStampPattern-1012369784 None] Deleted volume successfully. Jul 08 01:24:37 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-96685e7c-722d-4911-a708-c47e66314832 tempest-TestStampPattern-1012369784 None] Lock "cinder-cfcb1279-1adf-460f-8a50-ee507a6fb22c-delete_volume" released by "delete_volume" :: held 2.613s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:37 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-38d0caa3-14e5-405b-a551-c09c28f2bc65 tempest-SnapshotDependencyTests-1669105759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566" returned: 0 in 0.947s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-38d0caa3-14e5-405b-a551-c09c28f2bc65 tempest-SnapshotDependencyTests-1669105759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566.9db27264-53bf-4a2b-91be-464a757c0edb {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:37 devstack sudo[103022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566.9db27264-53bf-4a2b-91be-464a757c0edb Jul 08 01:24:37 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:37 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-3fe74368-c9e6-4ab4-983b-40687e589622 req-e8afb40d-ee32-4212-bd2f-8a03b2c10797 tempest-TestShelveInstance-205099010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4" returned: 0 in 1.021s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-3fe74368-c9e6-4ab4-983b-40687e589622 req-e8afb40d-ee32-4212-bd2f-8a03b2c10797 tempest-TestShelveInstance-205099010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:37 devstack sudo[103024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4 Jul 08 01:24:37 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:38 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-3fe74368-c9e6-4ab4-983b-40687e589622 req-e8afb40d-ee32-4212-bd2f-8a03b2c10797 tempest-TestShelveInstance-205099010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4" returned: 1 in 0.902s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-3fe74368-c9e6-4ab4-983b-40687e589622 req-e8afb40d-ee32-4212-bd2f-8a03b2c10797 tempest-TestShelveInstance-205099010 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:24:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-3fe74368-c9e6-4ab4-983b-40687e589622 req-e8afb40d-ee32-4212-bd2f-8a03b2c10797 tempest-TestShelveInstance-205099010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.999s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:38 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-38d0caa3-14e5-405b-a551-c09c28f2bc65 tempest-SnapshotDependencyTests-1669105759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566.9db27264-53bf-4a2b-91be-464a757c0edb" returned: 0 in 0.971s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-38d0caa3-14e5-405b-a551-c09c28f2bc65 tempest-SnapshotDependencyTests-1669105759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566.9db27264-53bf-4a2b-91be-464a757c0edb {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:38 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566.9db27264-53bf-4a2b-91be-464a757c0edb Jul 08 01:24:38 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-3fe74368-c9e6-4ab4-983b-40687e589622 req-e8afb40d-ee32-4212-bd2f-8a03b2c10797 tempest-TestShelveInstance-205099010 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d', 'name': 'volume-0043041b-f13c-43e6-a242-f2e929bb85c4', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1e7fb97-abcf-4138-a404-0688ea8664cf', 'enforce_multipath': True} {{(pid=87022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:24:38 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-3fe74368-c9e6-4ab4-983b-40687e589622 req-e8afb40d-ee32-4212-bd2f-8a03b2c10797 tempest-TestShelveInstance-205099010 None] attachment_update completed successfully. Jul 08 01:24:39 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-38d0caa3-14e5-405b-a551-c09c28f2bc65 tempest-SnapshotDependencyTests-1669105759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566.9db27264-53bf-4a2b-91be-464a757c0edb" returned: 0 in 0.706s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:39 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-38d0caa3-14e5-405b-a551-c09c28f2bc65 tempest-SnapshotDependencyTests-1669105759 None] Lock "cinder-quobyte-9db27264-53bf-4a2b-91be-464a757c0edb" released by "_delete_snapshot" :: held 3.649s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:39 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-38d0caa3-14e5-405b-a551-c09c28f2bc65 tempest-SnapshotDependencyTests-1669105759 None] Lock "cinder-quobyte-e672cf41-cff9-4f80-9518-00a6ad23f566" released by "delete_snapshot" :: held 3.670s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:39 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-38d0caa3-14e5-405b-a551-c09c28f2bc65 tempest-SnapshotDependencyTests-1669105759 None] Created reservations ['f6cf6aaa-02d6-4de4-b7d0-a473f9b67d39', '8883fc5a-b746-4dfd-a95c-b3bdfd76819f', '97c75d85-b93b-40d7-818d-eb0c2479399c', '9fa1b209-46e1-4188-aa19-8211d2db18ab'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:39 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-38d0caa3-14e5-405b-a551-c09c28f2bc65 tempest-SnapshotDependencyTests-1669105759 None] Delete snapshot completed successfully. Jul 08 01:24:39 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-38d0caa3-14e5-405b-a551-c09c28f2bc65 tempest-SnapshotDependencyTests-1669105759 None] Lock "cinder-9db27264-53bf-4a2b-91be-464a757c0edb-delete_snapshot" released by "delete_snapshot" :: held 3.808s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:39 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f2776578-f541-4faa-84dc-d250acc5cbcb tempest-SnapshotDependencyTests-1669105759 None] Acquiring lock "cinder-e672cf41-cff9-4f80-9518-00a6ad23f566-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:39 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f2776578-f541-4faa-84dc-d250acc5cbcb tempest-SnapshotDependencyTests-1669105759 None] Lock "cinder-e672cf41-cff9-4f80-9518-00a6ad23f566-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:39 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f2776578-f541-4faa-84dc-d250acc5cbcb tempest-SnapshotDependencyTests-1669105759 None] Acquiring lock "cinder-quobyte-e672cf41-cff9-4f80-9518-00a6ad23f566" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:39 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f2776578-f541-4faa-84dc-d250acc5cbcb tempest-SnapshotDependencyTests-1669105759 None] Lock "cinder-quobyte-e672cf41-cff9-4f80-9518-00a6ad23f566" acquired by "delete_volume" :: waited 0.014s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:40 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[027080b9-7588-47d8-a616-ed042cdc9d59]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f2776578-f541-4faa-84dc-d250acc5cbcb tempest-SnapshotDependencyTests-1669105759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:40 devstack sudo[103037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566 Jul 08 01:24:40 devstack sudo[103037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:40 devstack sudo[103037]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f2776578-f541-4faa-84dc-d250acc5cbcb tempest-SnapshotDependencyTests-1669105759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566" returned: 0 in 0.904s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f2776578-f541-4faa-84dc-d250acc5cbcb tempest-SnapshotDependencyTests-1669105759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:40 devstack sudo[103042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566 Jul 08 01:24:40 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:41 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f2776578-f541-4faa-84dc-d250acc5cbcb tempest-SnapshotDependencyTests-1669105759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e672cf41-cff9-4f80-9518-00a6ad23f566" returned: 0 in 0.808s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:41 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f2776578-f541-4faa-84dc-d250acc5cbcb tempest-SnapshotDependencyTests-1669105759 None] Lock "cinder-quobyte-e672cf41-cff9-4f80-9518-00a6ad23f566" released by "delete_volume" :: held 1.783s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:41 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-f2776578-f541-4faa-84dc-d250acc5cbcb tempest-SnapshotDependencyTests-1669105759 None] Created reservations ['4516342a-794c-42ee-bd70-33f0d75770e9', '9edb3f85-62cb-42a5-b91e-94a2de9c706a', '5b8bcfd8-7e9a-4137-8561-347a18a0daad', 'feb8cdf9-271c-4f96-b5f1-279641850b86'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f2776578-f541-4faa-84dc-d250acc5cbcb tempest-SnapshotDependencyTests-1669105759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f2776578-f541-4faa-84dc-d250acc5cbcb tempest-SnapshotDependencyTests-1669105759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:41 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f2776578-f541-4faa-84dc-d250acc5cbcb tempest-SnapshotDependencyTests-1669105759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:41 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f2776578-f541-4faa-84dc-d250acc5cbcb tempest-SnapshotDependencyTests-1669105759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f2776578-f541-4faa-84dc-d250acc5cbcb tempest-SnapshotDependencyTests-1669105759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f2776578-f541-4faa-84dc-d250acc5cbcb tempest-SnapshotDependencyTests-1669105759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:41 devstack sudo[103046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:24:41 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f90fa469-2a59-480c-8e17-949490028b94 tempest-SnapshotDependencyTests-1669105759 None] Acquiring lock "cinder-5c4f9aa1-0044-44fe-928f-da10b78ec587-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f90fa469-2a59-480c-8e17-949490028b94 tempest-SnapshotDependencyTests-1669105759 None] Lock "cinder-5c4f9aa1-0044-44fe-928f-da10b78ec587-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f90fa469-2a59-480c-8e17-949490028b94 tempest-SnapshotDependencyTests-1669105759 None] Acquiring lock "cinder-quobyte-5c4f9aa1-0044-44fe-928f-da10b78ec587" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f90fa469-2a59-480c-8e17-949490028b94 tempest-SnapshotDependencyTests-1669105759 None] Lock "cinder-quobyte-5c4f9aa1-0044-44fe-928f-da10b78ec587" acquired by "delete_volume" :: waited 0.029s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:42 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bdde7a-e401-4f4f-8333-11fd5630d010]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f90fa469-2a59-480c-8e17-949490028b94 tempest-SnapshotDependencyTests-1669105759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c4f9aa1-0044-44fe-928f-da10b78ec587 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:42 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c4f9aa1-0044-44fe-928f-da10b78ec587 Jul 08 01:24:42 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:42 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f2776578-f541-4faa-84dc-d250acc5cbcb tempest-SnapshotDependencyTests-1669105759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.807s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:42 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-f2776578-f541-4faa-84dc-d250acc5cbcb tempest-SnapshotDependencyTests-1669105759 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:42 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-f2776578-f541-4faa-84dc-d250acc5cbcb tempest-SnapshotDependencyTests-1669105759 None] Deleted volume successfully. Jul 08 01:24:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f2776578-f541-4faa-84dc-d250acc5cbcb tempest-SnapshotDependencyTests-1669105759 None] Lock "cinder-e672cf41-cff9-4f80-9518-00a6ad23f566-delete_volume" released by "delete_volume" :: held 2.872s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:43 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f90fa469-2a59-480c-8e17-949490028b94 tempest-SnapshotDependencyTests-1669105759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c4f9aa1-0044-44fe-928f-da10b78ec587" returned: 0 in 0.915s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f90fa469-2a59-480c-8e17-949490028b94 tempest-SnapshotDependencyTests-1669105759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c4f9aa1-0044-44fe-928f-da10b78ec587 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:43 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c4f9aa1-0044-44fe-928f-da10b78ec587 Jul 08 01:24:43 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:44 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f90fa469-2a59-480c-8e17-949490028b94 tempest-SnapshotDependencyTests-1669105759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c4f9aa1-0044-44fe-928f-da10b78ec587" returned: 0 in 0.726s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:44 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f90fa469-2a59-480c-8e17-949490028b94 tempest-SnapshotDependencyTests-1669105759 None] Lock "cinder-quobyte-5c4f9aa1-0044-44fe-928f-da10b78ec587" released by "delete_volume" :: held 1.726s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:44 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-f90fa469-2a59-480c-8e17-949490028b94 tempest-SnapshotDependencyTests-1669105759 None] Created reservations ['983c32a7-114c-46ac-acf7-a767736ba00b', 'b4d994d2-82b5-41c6-99e3-13b0ed386bd9', '52a894fc-ed4a-4abd-830a-c33984a409b9', 'dbac1a6c-d0ca-4605-bf97-a3732a6e4058'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f90fa469-2a59-480c-8e17-949490028b94 tempest-SnapshotDependencyTests-1669105759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f90fa469-2a59-480c-8e17-949490028b94 tempest-SnapshotDependencyTests-1669105759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f90fa469-2a59-480c-8e17-949490028b94 tempest-SnapshotDependencyTests-1669105759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f90fa469-2a59-480c-8e17-949490028b94 tempest-SnapshotDependencyTests-1669105759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f90fa469-2a59-480c-8e17-949490028b94 tempest-SnapshotDependencyTests-1669105759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f90fa469-2a59-480c-8e17-949490028b94 tempest-SnapshotDependencyTests-1669105759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:44 devstack sudo[103059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:24:44 devstack sudo[103059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:44 devstack sudo[103059]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f90fa469-2a59-480c-8e17-949490028b94 tempest-SnapshotDependencyTests-1669105759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.741s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:45 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-f90fa469-2a59-480c-8e17-949490028b94 tempest-SnapshotDependencyTests-1669105759 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:45 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-f90fa469-2a59-480c-8e17-949490028b94 tempest-SnapshotDependencyTests-1669105759 None] Deleted volume successfully. Jul 08 01:24:45 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f90fa469-2a59-480c-8e17-949490028b94 tempest-SnapshotDependencyTests-1669105759 None] Lock "cinder-5c4f9aa1-0044-44fe-928f-da10b78ec587-delete_volume" released by "delete_volume" :: held 2.870s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:45 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:24:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:45 devstack sudo[103063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:24:45 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:46 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.707s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:46 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:46 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:24:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread count: 28 {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:24:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread info: [<_MainThread(MainThread, started 134382216167552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:24:54 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=35,cinder:INSERT=10,cinder:UPDATE=39,cinder:DELETE=3 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:24:55 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=29,cinder:INSERT=10,cinder:UPDATE=41,cinder:DELETE=2 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:24:55 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:24:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Flow 'volume_create_manager' (de7711ee-b8eb-4cc0-8eff-e6e2f36fee53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11baf923-50c3-443f-ab20-bfc76b8c3773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11baf923-50c3-443f-ab20-bfc76b8c3773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4322a493-eaf9-408e-a796-2d31e00474df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa33207723c48c396b741375a38d0a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:55Z,use_quota=True,user_id='e7f456229f834c60a0ba6a1904c5294e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(072a8dcb-e101-486a-8ca6-a0f23e2d99c5),volume_type_id=072a8dcb-e101-486a-8ca6-a0f23e2d99c5)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a2bdcb0-6dda-444b-b0bd-592f32e57797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a2bdcb0-6dda-444b-b0bd-592f32e57797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cee9c878-2824-4abc-a8e4-96a23a815c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:55 devstack cinder-volume[87022]: DEBUG cinder.image.glance [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Creating Keystone auth plugin from conf {{(pid=87022) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:24:56 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cee9c878-2824-4abc-a8e4-96a23a815c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4322a493-eaf9-408e-a796-2d31e00474df', 'volume_name': 'volume-4322a493-eaf9-408e-a796-2d31e00474df', 'volume_size': 1, 'image_id': 'a14ba42d-8a37-421c-bc09-c302062bec8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a14ba42d-8a37-421c-bc09-c302062bec8a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '60905cc29a799dd39da5a2a579ca2ca3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8aa33207723c48c396b741375a38d0a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '249c0369333d8858e0a4f694aff4476e7a91299c2175a25483d6c81ed2cbb65ebb6f36c2612f8a9b5050371a18b16a0976be1ce19d36b6875af75b9557aa065f', 'id': 'a14ba42d-8a37-421c-bc09-c302062bec8a', 'created_at': datetime.datetime(2026, 7, 7, 23, 24, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 24, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a14ba42d-8a37-421c-bc09-c302062bec8a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:56 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (966cda25-2141-4b18-b348-f661a265fc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:56 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (966cda25-2141-4b18-b348-f661a265fc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:56 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fb665c5-1cca-4c70-9fb7-0868da9f418b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:56 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Volume 4322a493-eaf9-408e-a796-2d31e00474df: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4322a493-eaf9-408e-a796-2d31e00474df', 'volume_size': 1, 'image_id': 'a14ba42d-8a37-421c-bc09-c302062bec8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a14ba42d-8a37-421c-bc09-c302062bec8a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '60905cc29a799dd39da5a2a579ca2ca3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8aa33207723c48c396b741375a38d0a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '249c0369333d8858e0a4f694aff4476e7a91299c2175a25483d6c81ed2cbb65ebb6f36c2612f8a9b5050371a18b16a0976be1ce19d36b6875af75b9557aa065f', 'id': 'a14ba42d-8a37-421c-bc09-c302062bec8a', 'created_at': datetime.datetime(2026, 7, 7, 23, 24, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 24, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a14ba42d-8a37-421c-bc09-c302062bec8a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 01:24:56 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Trying to clone 4322a493-eaf9-408e-a796-2d31e00474df from image a14ba42d-8a37-421c-bc09-c302062bec8a at location (None, [{'url': 'file:///opt/stack/data/glance/images/a14ba42d-8a37-421c-bc09-c302062bec8a', 'metadata': {}}]). {{(pid=87022) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:24:56 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a14ba42d-8a37-421c-bc09-c302062bec8a_880pc6bxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87022) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:24:56 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Image download 0.00 MB at 0.00 MB/s Jul 08 01:24:56 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d626ec8-6f42-48fe-b6d5-7dad7d6dd85a]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a14ba42d-8a37-421c-bc09-c302062bec8a_880pc6bxdevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:56 devstack sudo[103519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a14ba42d-8a37-421c-bc09-c302062bec8a_880pc6bxdevstack@QuobyteHD Jul 08 01:24:56 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:57 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a14ba42d-8a37-421c-bc09-c302062bec8a_880pc6bxdevstack@QuobyteHD" returned: 0 in 0.857s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a14ba42d-8a37-421c-bc09-c302062bec8a_880pc6bxdevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:57 devstack sudo[103523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a14ba42d-8a37-421c-bc09-c302062bec8a_880pc6bxdevstack@QuobyteHD Jul 08 01:24:57 devstack sudo[103523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:57 devstack sudo[103523]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a14ba42d-8a37-421c-bc09-c302062bec8a_880pc6bxdevstack@QuobyteHD" returned: 1 in 0.758s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a14ba42d-8a37-421c-bc09-c302062bec8a_880pc6bxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:24:57 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Temporary image a14ba42d-8a37-421c-bc09-c302062bec8a is fetched for user e7f456229f834c60a0ba6a1904c5294e. {{(pid=87022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:24:57 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df4ed3d-b637-4eb2-9098-744dcc9bf277]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a14ba42d-8a37-421c-bc09-c302062bec8a_880pc6bxdevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:58 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a14ba42d-8a37-421c-bc09-c302062bec8a_880pc6bxdevstack@QuobyteHD Jul 08 01:24:58 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:58 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a14ba42d-8a37-421c-bc09-c302062bec8a_880pc6bxdevstack@QuobyteHD" returned: 0 in 0.752s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a14ba42d-8a37-421c-bc09-c302062bec8a_880pc6bxdevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:58 devstack sudo[103533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a14ba42d-8a37-421c-bc09-c302062bec8a_880pc6bxdevstack@QuobyteHD Jul 08 01:24:58 devstack sudo[103533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:59 devstack sudo[103533]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a14ba42d-8a37-421c-bc09-c302062bec8a_880pc6bxdevstack@QuobyteHD" returned: 1 in 0.702s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a14ba42d-8a37-421c-bc09-c302062bec8a_880pc6bxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:24:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4322a493-eaf9-408e-a796-2d31e00474df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa33207723c48c396b741375a38d0a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:55Z,use_quota=True,user_id='e7f456229f834c60a0ba6a1904c5294e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(072a8dcb-e101-486a-8ca6-a0f23e2d99c5),volume_type_id=072a8dcb-e101-486a-8ca6-a0f23e2d99c5)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:24:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Creating volume 4322a493-eaf9-408e-a796-2d31e00474df {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:24:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:24:59 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:24:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:59 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df 1073741824 Jul 08 01:24:59 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:00 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df 1073741824" returned: 0 in 0.857s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:00 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df Jul 08 01:25:00 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:01 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df" returned: 0 in 0.683s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:25:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:01 devstack cinder-volume[87022]: DEBUG cinder.volume.volume_utils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Attempting download of a14ba42d-8a37-421c-bc09-c302062bec8a ((None, [{'url': 'file:///opt/stack/data/glance/images/a14ba42d-8a37-421c-bc09-c302062bec8a', 'metadata': {}}])) to volume 4322a493-eaf9-408e-a796-2d31e00474df. {{(pid=87022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:25:01 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d31dcd-3824-42de-89b7-c524e29a043e]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a14ba42d-8a37-421c-bc09-c302062bec8a_vjh6g0w3 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:01 devstack sudo[103547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a14ba42d-8a37-421c-bc09-c302062bec8a_vjh6g0w3 Jul 08 01:25:01 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:01 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a14ba42d-8a37-421c-bc09-c302062bec8a_vjh6g0w3" returned: 0 in 0.800s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a14ba42d-8a37-421c-bc09-c302062bec8a_vjh6g0w3 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:02 devstack sudo[103554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a14ba42d-8a37-421c-bc09-c302062bec8a_vjh6g0w3 Jul 08 01:25:02 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:02 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a14ba42d-8a37-421c-bc09-c302062bec8a_vjh6g0w3" returned: 1 in 0.784s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a14ba42d-8a37-421c-bc09-c302062bec8a_vjh6g0w3' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:25:02 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87ee46e-58fa-476e-9345-70dd230be915]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a14ba42d-8a37-421c-bc09-c302062bec8a_880pc6bxdevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:02 devstack sudo[103558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a14ba42d-8a37-421c-bc09-c302062bec8a_880pc6bxdevstack@QuobyteHD Jul 08 01:25:02 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:03 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a14ba42d-8a37-421c-bc09-c302062bec8a_880pc6bxdevstack@QuobyteHD" returned: 0 in 0.797s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a14ba42d-8a37-421c-bc09-c302062bec8a_880pc6bxdevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:03 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a14ba42d-8a37-421c-bc09-c302062bec8a_880pc6bxdevstack@QuobyteHD Jul 08 01:25:03 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:04 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a14ba42d-8a37-421c-bc09-c302062bec8a_880pc6bxdevstack@QuobyteHD" returned: 1 in 0.785s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a14ba42d-8a37-421c-bc09-c302062bec8a_880pc6bxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:25:04 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] a14ba42d-8a37-421c-bc09-c302062bec8a was raw, converting to raw {{(pid=87022) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:25:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a14ba42d-8a37-421c-bc09-c302062bec8a_880pc6bxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:04 devstack sudo[103567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a14ba42d-8a37-421c-bc09-c302062bec8a_880pc6bxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df Jul 08 01:25:04 devstack sudo[103567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:05 devstack sudo[103567]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a14ba42d-8a37-421c-bc09-c302062bec8a_880pc6bxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df" returned: 0 in 0.767s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:05 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a14ba42d-8a37-421c-bc09-c302062bec8a_880pc6bxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df {{(pid=87022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:25:05 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 01:25:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:05 devstack sudo[103572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df 1G Jul 08 01:25:05 devstack sudo[103572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:05 devstack sudo[103572]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df 1G" returned: 0 in 0.710s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:05 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03bb7b0-fbe7-4f62-8744-41e77b2ef37c]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:05 devstack sudo[103578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df Jul 08 01:25:05 devstack sudo[103578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:06 devstack sudo[103578]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df" returned: 0 in 0.895s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:06 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df Jul 08 01:25:06 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:07 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df" returned: 1 in 0.840s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:25:07 devstack cinder-volume[87022]: DEBUG cinder.volume.volume_utils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Downloaded image a14ba42d-8a37-421c-bc09-c302062bec8a ((None, [{'url': 'file:///opt/stack/data/glance/images/a14ba42d-8a37-421c-bc09-c302062bec8a', 'metadata': {}}])) to volume 4322a493-eaf9-408e-a796-2d31e00474df successfully. {{(pid=87022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:25:07 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Temporary image a14ba42d-8a37-421c-bc09-c302062bec8a for user e7f456229f834c60a0ba6a1904c5294e is deleted. {{(pid=87022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:25:07 devstack cinder-volume[87022]: DEBUG cinder.volume.volume_utils [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Marking volume 4322a493-eaf9-408e-a796-2d31e00474df as bootable. {{(pid=87022) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:25:07 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Copying metadata from image a14ba42d-8a37-421c-bc09-c302062bec8a to 4322a493-eaf9-408e-a796-2d31e00474df. {{(pid=87022) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:25:07 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Creating volume glance metadata for volume 4322a493-eaf9-408e-a796-2d31e00474df backed by image a14ba42d-8a37-421c-bc09-c302062bec8a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a14ba42d-8a37-421c-bc09-c302062bec8a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '60905cc29a799dd39da5a2a579ca2ca3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87022) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:25:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fb665c5-1cca-4c70-9fb7-0868da9f418b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4322a493-eaf9-408e-a796-2d31e00474df', 'volume_size': 1, 'image_id': 'a14ba42d-8a37-421c-bc09-c302062bec8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a14ba42d-8a37-421c-bc09-c302062bec8a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '60905cc29a799dd39da5a2a579ca2ca3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8aa33207723c48c396b741375a38d0a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '249c0369333d8858e0a4f694aff4476e7a91299c2175a25483d6c81ed2cbb65ebb6f36c2612f8a9b5050371a18b16a0976be1ce19d36b6875af75b9557aa065f', 'id': 'a14ba42d-8a37-421c-bc09-c302062bec8a', 'created_at': datetime.datetime(2026, 7, 7, 23, 24, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 24, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a14ba42d-8a37-421c-bc09-c302062bec8a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6caac311-2603-40bb-a126-df014aabdba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:07 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Volume volume-4322a493-eaf9-408e-a796-2d31e00474df (4322a493-eaf9-408e-a796-2d31e00474df): created successfully Jul 08 01:25:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6caac311-2603-40bb-a126-df014aabdba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Flow 'volume_create_manager' (de7711ee-b8eb-4cc0-8eff-e6e2f36fee53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:07 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-b2e81f3c-6103-4f73-96e8-67797378c557 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Created volume successfully. Jul 08 01:25:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6409e2d9-cc75-4f2b-9f91-1578dcb0fb98 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Acquiring lock "cinder-4322a493-eaf9-408e-a796-2d31e00474df-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6409e2d9-cc75-4f2b-9f91-1578dcb0fb98 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Lock "cinder-4322a493-eaf9-408e-a796-2d31e00474df-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6409e2d9-cc75-4f2b-9f91-1578dcb0fb98 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Acquiring lock "cinder-quobyte-4322a493-eaf9-408e-a796-2d31e00474df" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6409e2d9-cc75-4f2b-9f91-1578dcb0fb98 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Lock "cinder-quobyte-4322a493-eaf9-408e-a796-2d31e00474df" acquired by "delete_volume" :: waited 0.014s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:08 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[5083d838-715a-4699-8aae-ecf09006e5b9]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6409e2d9-cc75-4f2b-9f91-1578dcb0fb98 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:08 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df Jul 08 01:25:08 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:09 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6409e2d9-cc75-4f2b-9f91-1578dcb0fb98 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df" returned: 0 in 0.751s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6409e2d9-cc75-4f2b-9f91-1578dcb0fb98 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:09 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df Jul 08 01:25:09 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:09 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6409e2d9-cc75-4f2b-9f91-1578dcb0fb98 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df" returned: 1 in 0.765s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6409e2d9-cc75-4f2b-9f91-1578dcb0fb98 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:25:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6409e2d9-cc75-4f2b-9f91-1578dcb0fb98 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:09 devstack sudo[103959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df Jul 08 01:25:09 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:10 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6409e2d9-cc75-4f2b-9f91-1578dcb0fb98 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4322a493-eaf9-408e-a796-2d31e00474df" returned: 0 in 0.722s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:10 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6409e2d9-cc75-4f2b-9f91-1578dcb0fb98 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Lock "cinder-quobyte-4322a493-eaf9-408e-a796-2d31e00474df" released by "delete_volume" :: held 2.302s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:10 devstack cinder-volume[87022]: WARNING cinder.quota [None req-6409e2d9-cc75-4f2b-9f91-1578dcb0fb98 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:25:10 devstack cinder-volume[87022]: WARNING cinder.quota [None req-6409e2d9-cc75-4f2b-9f91-1578dcb0fb98 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:25:10 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-6409e2d9-cc75-4f2b-9f91-1578dcb0fb98 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Created reservations ['7ef5d935-aac0-42e6-864d-5221a533a18e', '0ebd531b-0a71-410e-969a-d62cb20302ab', '252d7835-1236-41b0-8094-5191f109da18', 'f7ca808b-5e90-4881-a956-5f046559f264'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:25:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6409e2d9-cc75-4f2b-9f91-1578dcb0fb98 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6409e2d9-cc75-4f2b-9f91-1578dcb0fb98 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-6409e2d9-cc75-4f2b-9f91-1578dcb0fb98 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-6409e2d9-cc75-4f2b-9f91-1578dcb0fb98 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6409e2d9-cc75-4f2b-9f91-1578dcb0fb98 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6409e2d9-cc75-4f2b-9f91-1578dcb0fb98 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:10 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:25:10 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:11 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6409e2d9-cc75-4f2b-9f91-1578dcb0fb98 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.649s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:11 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-6409e2d9-cc75-4f2b-9f91-1578dcb0fb98 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:25:11 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-6409e2d9-cc75-4f2b-9f91-1578dcb0fb98 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Deleted volume successfully. Jul 08 01:25:11 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6409e2d9-cc75-4f2b-9f91-1578dcb0fb98 tempest-VolumeAndVolumeTypeFromImageTest-1334962323 None] Lock "cinder-4322a493-eaf9-408e-a796-2d31e00474df-delete_volume" released by "delete_volume" :: held 3.174s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:20 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=16,cinder:UPDATE=16,cinder:INSERT=8 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:25:20 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-22721f67-9b7a-4b38-a63e-e2312c3f4e83 req-d1e35c0f-7450-44e8-9759-596124424f0c tempest-TestShelveInstance-205099010 None] Terminate volume connection completed successfully. Jul 08 01:25:20 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [req-22721f67-9b7a-4b38-a63e-e2312c3f4e83 req-d1e35c0f-7450-44e8-9759-596124424f0c tempest-TestShelveInstance-205099010 None] Deleting attachment e1e7fb97-abcf-4138-a404-0688ea8664cf. {{(pid=87022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:25:21 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=10,cinder:UPDATE=9,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:25:21 devstack cinder-volume[87022]: DEBUG cinder.coordination [req-22721f67-9b7a-4b38-a63e-e2312c3f4e83 req-ffb2aa5a-1b32-4aec-b821-b84007ce626c tempest-TestShelveInstance-205099010 None] Acquiring lock "cinder-0043041b-f13c-43e6-a242-f2e929bb85c4-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:21 devstack cinder-volume[87022]: DEBUG cinder.coordination [req-22721f67-9b7a-4b38-a63e-e2312c3f4e83 req-ffb2aa5a-1b32-4aec-b821-b84007ce626c tempest-TestShelveInstance-205099010 None] Lock "cinder-0043041b-f13c-43e6-a242-f2e929bb85c4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:21 devstack cinder-volume[87022]: DEBUG cinder.coordination [req-22721f67-9b7a-4b38-a63e-e2312c3f4e83 req-ffb2aa5a-1b32-4aec-b821-b84007ce626c tempest-TestShelveInstance-205099010 None] Acquiring lock "cinder-quobyte-0043041b-f13c-43e6-a242-f2e929bb85c4" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:21 devstack cinder-volume[87022]: DEBUG cinder.coordination [req-22721f67-9b7a-4b38-a63e-e2312c3f4e83 req-ffb2aa5a-1b32-4aec-b821-b84007ce626c tempest-TestShelveInstance-205099010 None] Lock "cinder-quobyte-0043041b-f13c-43e6-a242-f2e929bb85c4" acquired by "delete_volume" :: waited 0.016s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:21 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d49e98-fd1c-4a3a-b16e-a371affe2f53]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-22721f67-9b7a-4b38-a63e-e2312c3f4e83 req-ffb2aa5a-1b32-4aec-b821-b84007ce626c tempest-TestShelveInstance-205099010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:21 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4 Jul 08 01:25:21 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:22 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-22721f67-9b7a-4b38-a63e-e2312c3f4e83 req-ffb2aa5a-1b32-4aec-b821-b84007ce626c tempest-TestShelveInstance-205099010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4" returned: 0 in 0.835s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-22721f67-9b7a-4b38-a63e-e2312c3f4e83 req-ffb2aa5a-1b32-4aec-b821-b84007ce626c tempest-TestShelveInstance-205099010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:22 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4 Jul 08 01:25:22 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:23 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-22721f67-9b7a-4b38-a63e-e2312c3f4e83 req-ffb2aa5a-1b32-4aec-b821-b84007ce626c tempest-TestShelveInstance-205099010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4" returned: 1 in 0.818s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-22721f67-9b7a-4b38-a63e-e2312c3f4e83 req-ffb2aa5a-1b32-4aec-b821-b84007ce626c tempest-TestShelveInstance-205099010 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:25:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-22721f67-9b7a-4b38-a63e-e2312c3f4e83 req-ffb2aa5a-1b32-4aec-b821-b84007ce626c tempest-TestShelveInstance-205099010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:23 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4 Jul 08 01:25:23 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:24 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-22721f67-9b7a-4b38-a63e-e2312c3f4e83 req-ffb2aa5a-1b32-4aec-b821-b84007ce626c tempest-TestShelveInstance-205099010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0043041b-f13c-43e6-a242-f2e929bb85c4" returned: 0 in 0.677s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [req-22721f67-9b7a-4b38-a63e-e2312c3f4e83 req-ffb2aa5a-1b32-4aec-b821-b84007ce626c tempest-TestShelveInstance-205099010 None] Lock "cinder-quobyte-0043041b-f13c-43e6-a242-f2e929bb85c4" released by "delete_volume" :: held 2.396s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:24 devstack cinder-volume[87022]: DEBUG cinder.quota [req-22721f67-9b7a-4b38-a63e-e2312c3f4e83 req-ffb2aa5a-1b32-4aec-b821-b84007ce626c tempest-TestShelveInstance-205099010 None] Created reservations ['9b7b2df4-4b78-4ebb-bf6a-310340a4b3d0', 'a43b90a6-7eba-4199-bfcd-dd8d73b353ac', '4b589f26-2add-4d07-919c-946a5822d4f2', '522759b8-467f-4af0-8760-286c7dfc4f95'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:25:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-22721f67-9b7a-4b38-a63e-e2312c3f4e83 req-ffb2aa5a-1b32-4aec-b821-b84007ce626c tempest-TestShelveInstance-205099010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-22721f67-9b7a-4b38-a63e-e2312c3f4e83 req-ffb2aa5a-1b32-4aec-b821-b84007ce626c tempest-TestShelveInstance-205099010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [req-22721f67-9b7a-4b38-a63e-e2312c3f4e83 req-ffb2aa5a-1b32-4aec-b821-b84007ce626c tempest-TestShelveInstance-205099010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [req-22721f67-9b7a-4b38-a63e-e2312c3f4e83 req-ffb2aa5a-1b32-4aec-b821-b84007ce626c tempest-TestShelveInstance-205099010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [req-22721f67-9b7a-4b38-a63e-e2312c3f4e83 req-ffb2aa5a-1b32-4aec-b821-b84007ce626c tempest-TestShelveInstance-205099010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-22721f67-9b7a-4b38-a63e-e2312c3f4e83 req-ffb2aa5a-1b32-4aec-b821-b84007ce626c tempest-TestShelveInstance-205099010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:24 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:25:24 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:24 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [req-22721f67-9b7a-4b38-a63e-e2312c3f4e83 req-ffb2aa5a-1b32-4aec-b821-b84007ce626c tempest-TestShelveInstance-205099010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.727s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:24 devstack cinder-volume[87022]: DEBUG cinder.manager [req-22721f67-9b7a-4b38-a63e-e2312c3f4e83 req-ffb2aa5a-1b32-4aec-b821-b84007ce626c tempest-TestShelveInstance-205099010 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:25:24 devstack cinder-volume[87022]: INFO cinder.volume.manager [req-22721f67-9b7a-4b38-a63e-e2312c3f4e83 req-ffb2aa5a-1b32-4aec-b821-b84007ce626c tempest-TestShelveInstance-205099010 None] Deleted volume successfully. Jul 08 01:25:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [req-22721f67-9b7a-4b38-a63e-e2312c3f4e83 req-ffb2aa5a-1b32-4aec-b821-b84007ce626c tempest-TestShelveInstance-205099010 None] Lock "cinder-0043041b-f13c-43e6-a242-f2e929bb85c4-delete_volume" released by "delete_volume" :: held 3.344s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:34 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:UPDATE=8,cinder:SELECT=4,cinder:INSERT=2 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:25:34 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Flow 'volume_create_manager' (7e187b9a-b6f5-4a49-aeef-cfc8983fdbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5707cd8-7186-4f31-bf80-54d61f777395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5707cd8-7186-4f31-bf80-54d61f777395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1730687903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3e7e8a-6d20-4a55-b3fb-8557597a42d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d63a32f07c14f5f8e374d5aab4dadc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:36Z,use_quota=True,user_id='459d39bc2a4f42a38b075c040e094675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1097b3d9-5721-4bfa-b4c1-fac4bd94f554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1097b3d9-5721-4bfa-b4c1-fac4bd94f554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff4cde6c-91a2-43d0-8d29-ff2cbf53bebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff4cde6c-91a2-43d0-8d29-ff2cbf53bebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee3e7e8a-6d20-4a55-b3fb-8557597a42d7', 'volume_name': 'volume-ee3e7e8a-6d20-4a55-b3fb-8557597a42d7', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3614b5db-b003-476f-99f8-3676747bb4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3614b5db-b003-476f-99f8-3676747bb4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5be615-11dc-4560-b121-6887325b0f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:36 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Volume ee3e7e8a-6d20-4a55-b3fb-8557597a42d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee3e7e8a-6d20-4a55-b3fb-8557597a42d7', 'volume_size': 1} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1730687903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3e7e8a-6d20-4a55-b3fb-8557597a42d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d63a32f07c14f5f8e374d5aab4dadc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:36Z,use_quota=True,user_id='459d39bc2a4f42a38b075c040e094675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Creating volume ee3e7e8a-6d20-4a55-b3fb-8557597a42d7 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:25:36 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee3e7e8a-6d20-4a55-b3fb-8557597a42d7 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:36 devstack sudo[104150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee3e7e8a-6d20-4a55-b3fb-8557597a42d7 1073741824 Jul 08 01:25:36 devstack sudo[104150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Flow 'volume_create_manager' (3b6f69ef-f9c0-4f9f-a3ec-f45a2e6aee6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387cfca2-5c3f-490a-a7b6-19c661002fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387cfca2-5c3f-490a-a7b6-19c661002fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-874014824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8fffcd4-cd00-4292-a3a7-73ad45640574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d63a32f07c14f5f8e374d5aab4dadc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:36Z,use_quota=True,user_id='459d39bc2a4f42a38b075c040e094675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead1b42a-3020-45b4-a223-945edbff3a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead1b42a-3020-45b4-a223-945edbff3a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dba632b-ab71-4411-b3e8-0e5dbffe3e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dba632b-ab71-4411-b3e8-0e5dbffe3e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8fffcd4-cd00-4292-a3a7-73ad45640574', 'volume_name': 'volume-c8fffcd4-cd00-4292-a3a7-73ad45640574', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6e2c18f-ddbe-404c-bab1-20735b6b01f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6e2c18f-ddbe-404c-bab1-20735b6b01f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b7ea3c4-d1aa-4c6b-9d6e-f66be6a67cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:36 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Volume c8fffcd4-cd00-4292-a3a7-73ad45640574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8fffcd4-cd00-4292-a3a7-73ad45640574', 'volume_size': 1} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Flow 'volume_create_manager' (c8e1e1bd-af30-4470-ac59-c37ea4b071b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d888af3-1cc2-4b72-ba20-3f298941539d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d888af3-1cc2-4b72-ba20-3f298941539d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-215925682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41abd55f-0fe4-421f-a2ce-3bad549f2c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d63a32f07c14f5f8e374d5aab4dadc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:37Z,use_quota=True,user_id='459d39bc2a4f42a38b075c040e094675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be277cb-df53-4828-b21c-f02c66346658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be277cb-df53-4828-b21c-f02c66346658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e8c2019-02c4-4f9a-b667-280451d08a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e8c2019-02c4-4f9a-b667-280451d08a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41abd55f-0fe4-421f-a2ce-3bad549f2c55', 'volume_name': 'volume-41abd55f-0fe4-421f-a2ce-3bad549f2c55', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70885c9e-ea26-41fa-a343-fbb36bdbe171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70885c9e-ea26-41fa-a343-fbb36bdbe171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b852b467-c069-44d9-bfa0-451d1e1afba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:37 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Volume 41abd55f-0fe4-421f-a2ce-3bad549f2c55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41abd55f-0fe4-421f-a2ce-3bad549f2c55', 'volume_size': 1} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:37 devstack sudo[104150]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee3e7e8a-6d20-4a55-b3fb-8557597a42d7 1073741824" returned: 0 in 1.105s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee3e7e8a-6d20-4a55-b3fb-8557597a42d7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:37 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee3e7e8a-6d20-4a55-b3fb-8557597a42d7 Jul 08 01:25:37 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Flow 'volume_create_manager' (85a753ce-8763-42a3-a02f-ae7a40650502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7709b2cf-91e1-4f52-973f-66e84282ae95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7709b2cf-91e1-4f52-973f-66e84282ae95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-551487992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947f52aa-ca4b-4057-af09-59e885347522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d63a32f07c14f5f8e374d5aab4dadc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:37Z,use_quota=True,user_id='459d39bc2a4f42a38b075c040e094675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ac101e-fb34-41d9-82b3-0b58ed5bb96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ac101e-fb34-41d9-82b3-0b58ed5bb96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be640d7f-268a-4f56-87fb-b83b200da4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be640d7f-268a-4f56-87fb-b83b200da4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '947f52aa-ca4b-4057-af09-59e885347522', 'volume_name': 'volume-947f52aa-ca4b-4057-af09-59e885347522', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e17e75-1544-4b5a-b03e-ab145af65c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e17e75-1544-4b5a-b03e-ab145af65c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2798720a-ef91-481d-a6e1-dc0764cf37bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:37 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Volume 947f52aa-ca4b-4057-af09-59e885347522: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-947f52aa-ca4b-4057-af09-59e885347522', 'volume_size': 1} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Flow 'volume_create_manager' (91999e21-8a2f-44f5-be8e-5e8edb69a367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc9ad8b-f968-46e4-ad92-bfeeb7388462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc9ad8b-f968-46e4-ad92-bfeeb7388462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-834763759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bda3646-4c74-4511-8014-72df731d2465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d63a32f07c14f5f8e374d5aab4dadc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:38Z,use_quota=True,user_id='459d39bc2a4f42a38b075c040e094675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b00497c-9d4e-4967-98ba-ed29495b4b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b00497c-9d4e-4967-98ba-ed29495b4b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28574bc6-7517-4f43-ab34-1a8bdbca525f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28574bc6-7517-4f43-ab34-1a8bdbca525f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bda3646-4c74-4511-8014-72df731d2465', 'volume_name': 'volume-5bda3646-4c74-4511-8014-72df731d2465', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc51e5b-9b75-445f-9c52-7b9105697fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc51e5b-9b75-445f-9c52-7b9105697fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4edade4-bf33-4576-a2b1-de275dba84f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:37 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Volume 5bda3646-4c74-4511-8014-72df731d2465: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bda3646-4c74-4511-8014-72df731d2465', 'volume_size': 1} Jul 08 01:25:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:38 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee3e7e8a-6d20-4a55-b3fb-8557597a42d7" returned: 0 in 0.711s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] <== create_volume: return (1863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:25:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.460s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-874014824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8fffcd4-cd00-4292-a3a7-73ad45640574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d63a32f07c14f5f8e374d5aab4dadc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:36Z,use_quota=True,user_id='459d39bc2a4f42a38b075c040e094675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:25:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Creating volume c8fffcd4-cd00-4292-a3a7-73ad45640574 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:25:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:25:38 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:25:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c8fffcd4-cd00-4292-a3a7-73ad45640574 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:38 devstack sudo[104160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c8fffcd4-cd00-4292-a3a7-73ad45640574 1073741824 Jul 08 01:25:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5be615-11dc-4560-b121-6887325b0f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee3e7e8a-6d20-4a55-b3fb-8557597a42d7', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:38 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca0b4244-cd81-408f-9185-62ec1555c771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:38 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Volume volume-ee3e7e8a-6d20-4a55-b3fb-8557597a42d7 (ee3e7e8a-6d20-4a55-b3fb-8557597a42d7): created successfully Jul 08 01:25:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca0b4244-cd81-408f-9185-62ec1555c771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Flow 'volume_create_manager' (7e187b9a-b6f5-4a49-aeef-cfc8983fdbeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:38 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-ef800f0a-e3f0-46cd-a93a-1f47aec12689 tempest-CreateVolumesFromImageTest-914352645 None] Created volume successfully. Jul 08 01:25:39 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c8fffcd4-cd00-4292-a3a7-73ad45640574 1073741824" returned: 0 in 0.902s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c8fffcd4-cd00-4292-a3a7-73ad45640574 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:39 devstack sudo[104166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c8fffcd4-cd00-4292-a3a7-73ad45640574 Jul 08 01:25:39 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:39 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c8fffcd4-cd00-4292-a3a7-73ad45640574" returned: 0 in 0.701s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:39 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:25:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.719s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:39 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-215925682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41abd55f-0fe4-421f-a2ce-3bad549f2c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d63a32f07c14f5f8e374d5aab4dadc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:37Z,use_quota=True,user_id='459d39bc2a4f42a38b075c040e094675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:25:39 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Creating volume 41abd55f-0fe4-421f-a2ce-3bad549f2c55 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:25:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:39 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:39 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:39 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:25:39 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:25:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41abd55f-0fe4-421f-a2ce-3bad549f2c55 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b7ea3c4-d1aa-4c6b-9d6e-f66be6a67cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8fffcd4-cd00-4292-a3a7-73ad45640574', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:39 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41abd55f-0fe4-421f-a2ce-3bad549f2c55 1073741824 Jul 08 01:25:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d3fc62f-0882-4cdb-af06-b60d0a8d1894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:39 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:39 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Volume volume-c8fffcd4-cd00-4292-a3a7-73ad45640574 (c8fffcd4-cd00-4292-a3a7-73ad45640574): created successfully Jul 08 01:25:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d3fc62f-0882-4cdb-af06-b60d0a8d1894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Flow 'volume_create_manager' (3b6f69ef-f9c0-4f9f-a3ec-f45a2e6aee6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:39 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-a8b9b488-b5b8-434c-9194-3115638a51c9 tempest-CreateVolumesFromImageTest-914352645 None] Created volume successfully. Jul 08 01:25:40 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41abd55f-0fe4-421f-a2ce-3bad549f2c55 1073741824" returned: 0 in 0.838s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41abd55f-0fe4-421f-a2ce-3bad549f2c55 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:40 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41abd55f-0fe4-421f-a2ce-3bad549f2c55 Jul 08 01:25:40 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:41 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41abd55f-0fe4-421f-a2ce-3bad549f2c55" returned: 0 in 0.671s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:41 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:25:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.769s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:41 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-551487992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947f52aa-ca4b-4057-af09-59e885347522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d63a32f07c14f5f8e374d5aab4dadc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:37Z,use_quota=True,user_id='459d39bc2a4f42a38b075c040e094675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:25:41 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Creating volume 947f52aa-ca4b-4057-af09-59e885347522 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:25:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:41 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:41 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:41 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:25:41 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:25:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-947f52aa-ca4b-4057-af09-59e885347522 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:41 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b852b467-c069-44d9-bfa0-451d1e1afba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41abd55f-0fe4-421f-a2ce-3bad549f2c55', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:41 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-947f52aa-ca4b-4057-af09-59e885347522 1073741824 Jul 08 01:25:41 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:41 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24aaee99-4273-456a-a187-65ce03efd312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:41 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Volume volume-41abd55f-0fe4-421f-a2ce-3bad549f2c55 (41abd55f-0fe4-421f-a2ce-3bad549f2c55): created successfully Jul 08 01:25:41 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24aaee99-4273-456a-a187-65ce03efd312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:41 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Flow 'volume_create_manager' (c8e1e1bd-af30-4470-ac59-c37ea4b071b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:41 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-a688d289-56cf-455a-95ec-f6ad607379d5 tempest-CreateVolumesFromImageTest-914352645 None] Created volume successfully. Jul 08 01:25:42 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-947f52aa-ca4b-4057-af09-59e885347522 1073741824" returned: 0 in 0.876s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-947f52aa-ca4b-4057-af09-59e885347522 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:42 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-947f52aa-ca4b-4057-af09-59e885347522 Jul 08 01:25:42 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:42 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-947f52aa-ca4b-4057-af09-59e885347522" returned: 0 in 0.660s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:42 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:25:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.963s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:42 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-834763759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bda3646-4c74-4511-8014-72df731d2465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d63a32f07c14f5f8e374d5aab4dadc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:38Z,use_quota=True,user_id='459d39bc2a4f42a38b075c040e094675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:25:42 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Creating volume 5bda3646-4c74-4511-8014-72df731d2465 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:25:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:42 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:42 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:42 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:25:42 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:25:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5bda3646-4c74-4511-8014-72df731d2465 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:42 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5bda3646-4c74-4511-8014-72df731d2465 1073741824 Jul 08 01:25:42 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2798720a-ef91-481d-a6e1-dc0764cf37bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-947f52aa-ca4b-4057-af09-59e885347522', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a55ef95-d658-4d59-b4fb-90a92a3668f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:42 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Volume volume-947f52aa-ca4b-4057-af09-59e885347522 (947f52aa-ca4b-4057-af09-59e885347522): created successfully Jul 08 01:25:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a55ef95-d658-4d59-b4fb-90a92a3668f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Flow 'volume_create_manager' (85a753ce-8763-42a3-a02f-ae7a40650502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:43 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-bfd275c9-25fa-4ab6-883f-5ebbe8f4a521 tempest-CreateVolumesFromImageTest-914352645 None] Created volume successfully. Jul 08 01:25:43 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5bda3646-4c74-4511-8014-72df731d2465 1073741824" returned: 0 in 1.009s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5bda3646-4c74-4511-8014-72df731d2465 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:43 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5bda3646-4c74-4511-8014-72df731d2465 Jul 08 01:25:43 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:44 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5bda3646-4c74-4511-8014-72df731d2465" returned: 0 in 0.664s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:25:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4edade4-bf33-4576-a2b1-de275dba84f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bda3646-4c74-4511-8014-72df731d2465', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780d4628-27d2-4e54-b50b-f56d320fd52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:44 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Volume volume-5bda3646-4c74-4511-8014-72df731d2465 (5bda3646-4c74-4511-8014-72df731d2465): created successfully Jul 08 01:25:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780d4628-27d2-4e54-b50b-f56d320fd52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Flow 'volume_create_manager' (91999e21-8a2f-44f5-be8e-5e8edb69a367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:44 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-41213807-9bcd-40b1-a432-0c5c75792fdf tempest-CreateVolumesFromImageTest-914352645 None] Created volume successfully. Jul 08 01:25:45 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:25:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:45 devstack sudo[104196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:25:45 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:45 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-db805454-0ef3-424f-a92a-748889719999 tempest-CreateVolumesFromImageTest-914352645 None] Acquiring lock "cinder-5bda3646-4c74-4511-8014-72df731d2465-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:45 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-db805454-0ef3-424f-a92a-748889719999 tempest-CreateVolumesFromImageTest-914352645 None] Lock "cinder-5bda3646-4c74-4511-8014-72df731d2465-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:45 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-db805454-0ef3-424f-a92a-748889719999 tempest-CreateVolumesFromImageTest-914352645 None] Acquiring lock "cinder-quobyte-5bda3646-4c74-4511-8014-72df731d2465" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:45 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-db805454-0ef3-424f-a92a-748889719999 tempest-CreateVolumesFromImageTest-914352645 None] Lock "cinder-quobyte-5bda3646-4c74-4511-8014-72df731d2465" acquired by "delete_volume" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:45 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[312fef3c-8ad5-4987-996d-bb65b7a6661c]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-db805454-0ef3-424f-a92a-748889719999 tempest-CreateVolumesFromImageTest-914352645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5bda3646-4c74-4511-8014-72df731d2465 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:45 devstack sudo[104198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5bda3646-4c74-4511-8014-72df731d2465 Jul 08 01:25:45 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:46 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.655s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:46 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:25:46 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:25:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread count: 28 {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:25:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread info: [<_MainThread(MainThread, started 134382216167552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:25:46 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-db805454-0ef3-424f-a92a-748889719999 tempest-CreateVolumesFromImageTest-914352645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5bda3646-4c74-4511-8014-72df731d2465" returned: 0 in 0.768s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-db805454-0ef3-424f-a92a-748889719999 tempest-CreateVolumesFromImageTest-914352645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5bda3646-4c74-4511-8014-72df731d2465 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:46 devstack sudo[104204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5bda3646-4c74-4511-8014-72df731d2465 Jul 08 01:25:46 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:47 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-db805454-0ef3-424f-a92a-748889719999 tempest-CreateVolumesFromImageTest-914352645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5bda3646-4c74-4511-8014-72df731d2465" returned: 0 in 0.629s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:47 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-db805454-0ef3-424f-a92a-748889719999 tempest-CreateVolumesFromImageTest-914352645 None] Lock "cinder-quobyte-5bda3646-4c74-4511-8014-72df731d2465" released by "delete_volume" :: held 1.440s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:47 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-db805454-0ef3-424f-a92a-748889719999 tempest-CreateVolumesFromImageTest-914352645 None] Created reservations ['e950d302-51bd-4f7d-b445-c376f94ebb43', '7849d4fe-2117-4ccf-bd60-881eff4178fa', '79fe75f8-4d16-4734-82a1-3707a5ef82fa', '08f1e57f-b3c2-4f52-9761-dff355e54769'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:25:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-db805454-0ef3-424f-a92a-748889719999 tempest-CreateVolumesFromImageTest-914352645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-db805454-0ef3-424f-a92a-748889719999 tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:47 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-db805454-0ef3-424f-a92a-748889719999 tempest-CreateVolumesFromImageTest-914352645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:47 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-db805454-0ef3-424f-a92a-748889719999 tempest-CreateVolumesFromImageTest-914352645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-db805454-0ef3-424f-a92a-748889719999 tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-db805454-0ef3-424f-a92a-748889719999 tempest-CreateVolumesFromImageTest-914352645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:47 devstack sudo[104207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:25:47 devstack sudo[104207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:47 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-94ab1c2f-51c9-4892-92cd-628339856826 tempest-CreateVolumesFromImageTest-914352645 None] Acquiring lock "cinder-947f52aa-ca4b-4057-af09-59e885347522-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:47 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-94ab1c2f-51c9-4892-92cd-628339856826 tempest-CreateVolumesFromImageTest-914352645 None] Lock "cinder-947f52aa-ca4b-4057-af09-59e885347522-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:47 devstack sudo[104207]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-db805454-0ef3-424f-a92a-748889719999 tempest-CreateVolumesFromImageTest-914352645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.660s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:47 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-db805454-0ef3-424f-a92a-748889719999 tempest-CreateVolumesFromImageTest-914352645 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:25:47 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-db805454-0ef3-424f-a92a-748889719999 tempest-CreateVolumesFromImageTest-914352645 None] Deleted volume successfully. Jul 08 01:25:47 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-94ab1c2f-51c9-4892-92cd-628339856826 tempest-CreateVolumesFromImageTest-914352645 None] Acquiring lock "cinder-quobyte-947f52aa-ca4b-4057-af09-59e885347522" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:47 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-db805454-0ef3-424f-a92a-748889719999 tempest-CreateVolumesFromImageTest-914352645 None] Lock "cinder-5bda3646-4c74-4511-8014-72df731d2465-delete_volume" released by "delete_volume" :: held 2.318s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:47 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-94ab1c2f-51c9-4892-92cd-628339856826 tempest-CreateVolumesFromImageTest-914352645 None] Lock "cinder-quobyte-947f52aa-ca4b-4057-af09-59e885347522" acquired by "delete_volume" :: waited 0.023s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:47 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d62e101-3ba4-49c3-93b8-221f066fe08b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-94ab1c2f-51c9-4892-92cd-628339856826 tempest-CreateVolumesFromImageTest-914352645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-947f52aa-ca4b-4057-af09-59e885347522 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:48 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-947f52aa-ca4b-4057-af09-59e885347522 Jul 08 01:25:48 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:48 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-94ab1c2f-51c9-4892-92cd-628339856826 tempest-CreateVolumesFromImageTest-914352645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-947f52aa-ca4b-4057-af09-59e885347522" returned: 0 in 0.852s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-94ab1c2f-51c9-4892-92cd-628339856826 tempest-CreateVolumesFromImageTest-914352645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-947f52aa-ca4b-4057-af09-59e885347522 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:48 devstack sudo[104216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-947f52aa-ca4b-4057-af09-59e885347522 Jul 08 01:25:48 devstack sudo[104216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:49 devstack sudo[104216]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-94ab1c2f-51c9-4892-92cd-628339856826 tempest-CreateVolumesFromImageTest-914352645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-947f52aa-ca4b-4057-af09-59e885347522" returned: 0 in 0.826s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:49 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-94ab1c2f-51c9-4892-92cd-628339856826 tempest-CreateVolumesFromImageTest-914352645 None] Lock "cinder-quobyte-947f52aa-ca4b-4057-af09-59e885347522" released by "delete_volume" :: held 1.720s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:49 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-94ab1c2f-51c9-4892-92cd-628339856826 tempest-CreateVolumesFromImageTest-914352645 None] Created reservations ['625a43fc-591c-4a20-9df4-e8920e2875d2', '07c72fee-8218-43bf-9699-aa99dc765780', '1326ad84-f103-4ab6-982f-66f4c0ad1b5f', 'a7bb7b3f-6323-489d-bac3-b4d006158e7e'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:25:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-94ab1c2f-51c9-4892-92cd-628339856826 tempest-CreateVolumesFromImageTest-914352645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-94ab1c2f-51c9-4892-92cd-628339856826 tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:49 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-94ab1c2f-51c9-4892-92cd-628339856826 tempest-CreateVolumesFromImageTest-914352645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:49 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-94ab1c2f-51c9-4892-92cd-628339856826 tempest-CreateVolumesFromImageTest-914352645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-94ab1c2f-51c9-4892-92cd-628339856826 tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-94ab1c2f-51c9-4892-92cd-628339856826 tempest-CreateVolumesFromImageTest-914352645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:49 devstack sudo[104219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:25:49 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b2d13f30-7fea-46d2-9cbf-176623bbe294 tempest-CreateVolumesFromImageTest-914352645 None] Acquiring lock "cinder-41abd55f-0fe4-421f-a2ce-3bad549f2c55-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b2d13f30-7fea-46d2-9cbf-176623bbe294 tempest-CreateVolumesFromImageTest-914352645 None] Lock "cinder-41abd55f-0fe4-421f-a2ce-3bad549f2c55-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b2d13f30-7fea-46d2-9cbf-176623bbe294 tempest-CreateVolumesFromImageTest-914352645 None] Acquiring lock "cinder-quobyte-41abd55f-0fe4-421f-a2ce-3bad549f2c55" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b2d13f30-7fea-46d2-9cbf-176623bbe294 tempest-CreateVolumesFromImageTest-914352645 None] Lock "cinder-quobyte-41abd55f-0fe4-421f-a2ce-3bad549f2c55" acquired by "delete_volume" :: waited 0.030s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:50 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[9beeb6ba-bbd6-4860-a370-0423d611c034]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2d13f30-7fea-46d2-9cbf-176623bbe294 tempest-CreateVolumesFromImageTest-914352645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41abd55f-0fe4-421f-a2ce-3bad549f2c55 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:50 devstack sudo[104221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41abd55f-0fe4-421f-a2ce-3bad549f2c55 Jul 08 01:25:50 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:50 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-94ab1c2f-51c9-4892-92cd-628339856826 tempest-CreateVolumesFromImageTest-914352645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.700s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:50 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-94ab1c2f-51c9-4892-92cd-628339856826 tempest-CreateVolumesFromImageTest-914352645 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:25:50 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-94ab1c2f-51c9-4892-92cd-628339856826 tempest-CreateVolumesFromImageTest-914352645 None] Deleted volume successfully. Jul 08 01:25:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-94ab1c2f-51c9-4892-92cd-628339856826 tempest-CreateVolumesFromImageTest-914352645 None] Lock "cinder-947f52aa-ca4b-4057-af09-59e885347522-delete_volume" released by "delete_volume" :: held 2.652s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:50 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2d13f30-7fea-46d2-9cbf-176623bbe294 tempest-CreateVolumesFromImageTest-914352645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41abd55f-0fe4-421f-a2ce-3bad549f2c55" returned: 0 in 0.796s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2d13f30-7fea-46d2-9cbf-176623bbe294 tempest-CreateVolumesFromImageTest-914352645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41abd55f-0fe4-421f-a2ce-3bad549f2c55 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:51 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41abd55f-0fe4-421f-a2ce-3bad549f2c55 Jul 08 01:25:51 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:51 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2d13f30-7fea-46d2-9cbf-176623bbe294 tempest-CreateVolumesFromImageTest-914352645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-41abd55f-0fe4-421f-a2ce-3bad549f2c55" returned: 0 in 0.756s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:51 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b2d13f30-7fea-46d2-9cbf-176623bbe294 tempest-CreateVolumesFromImageTest-914352645 None] Lock "cinder-quobyte-41abd55f-0fe4-421f-a2ce-3bad549f2c55" released by "delete_volume" :: held 1.597s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:51 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-b2d13f30-7fea-46d2-9cbf-176623bbe294 tempest-CreateVolumesFromImageTest-914352645 None] Created reservations ['165fe49d-f628-45c1-8ec5-ef0b254c55c1', '178c3ae0-2be9-4335-82d5-fe961473941d', '8944e90b-7ac0-4ff5-b35e-083a06f5d8bd', '6380cfbb-4e2d-4ee2-8756-454d7fcda585'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:25:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b2d13f30-7fea-46d2-9cbf-176623bbe294 tempest-CreateVolumesFromImageTest-914352645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b2d13f30-7fea-46d2-9cbf-176623bbe294 tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:51 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b2d13f30-7fea-46d2-9cbf-176623bbe294 tempest-CreateVolumesFromImageTest-914352645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:51 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b2d13f30-7fea-46d2-9cbf-176623bbe294 tempest-CreateVolumesFromImageTest-914352645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b2d13f30-7fea-46d2-9cbf-176623bbe294 tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2d13f30-7fea-46d2-9cbf-176623bbe294 tempest-CreateVolumesFromImageTest-914352645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:51 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:25:51 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:52 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4b259932-6aa9-45af-9204-cd6993dd2f89 tempest-CreateVolumesFromImageTest-914352645 None] Acquiring lock "cinder-c8fffcd4-cd00-4292-a3a7-73ad45640574-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:52 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4b259932-6aa9-45af-9204-cd6993dd2f89 tempest-CreateVolumesFromImageTest-914352645 None] Lock "cinder-c8fffcd4-cd00-4292-a3a7-73ad45640574-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:52 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4b259932-6aa9-45af-9204-cd6993dd2f89 tempest-CreateVolumesFromImageTest-914352645 None] Acquiring lock "cinder-quobyte-c8fffcd4-cd00-4292-a3a7-73ad45640574" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:52 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4b259932-6aa9-45af-9204-cd6993dd2f89 tempest-CreateVolumesFromImageTest-914352645 None] Lock "cinder-quobyte-c8fffcd4-cd00-4292-a3a7-73ad45640574" acquired by "delete_volume" :: waited 0.018s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:52 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdd0ba3-d851-4565-9f51-43fb12832ab8]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4b259932-6aa9-45af-9204-cd6993dd2f89 tempest-CreateVolumesFromImageTest-914352645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c8fffcd4-cd00-4292-a3a7-73ad45640574 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:52 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b2d13f30-7fea-46d2-9cbf-176623bbe294 tempest-CreateVolumesFromImageTest-914352645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.667s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:52 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-b2d13f30-7fea-46d2-9cbf-176623bbe294 tempest-CreateVolumesFromImageTest-914352645 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:25:52 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-b2d13f30-7fea-46d2-9cbf-176623bbe294 tempest-CreateVolumesFromImageTest-914352645 None] Deleted volume successfully. Jul 08 01:25:52 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c8fffcd4-cd00-4292-a3a7-73ad45640574 Jul 08 01:25:52 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:52 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b2d13f30-7fea-46d2-9cbf-176623bbe294 tempest-CreateVolumesFromImageTest-914352645 None] Lock "cinder-41abd55f-0fe4-421f-a2ce-3bad549f2c55-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:53 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4b259932-6aa9-45af-9204-cd6993dd2f89 tempest-CreateVolumesFromImageTest-914352645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c8fffcd4-cd00-4292-a3a7-73ad45640574" returned: 0 in 0.810s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4b259932-6aa9-45af-9204-cd6993dd2f89 tempest-CreateVolumesFromImageTest-914352645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c8fffcd4-cd00-4292-a3a7-73ad45640574 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:53 devstack sudo[104238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c8fffcd4-cd00-4292-a3a7-73ad45640574 Jul 08 01:25:53 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:53 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4b259932-6aa9-45af-9204-cd6993dd2f89 tempest-CreateVolumesFromImageTest-914352645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c8fffcd4-cd00-4292-a3a7-73ad45640574" returned: 0 in 0.658s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:53 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4b259932-6aa9-45af-9204-cd6993dd2f89 tempest-CreateVolumesFromImageTest-914352645 None] Lock "cinder-quobyte-c8fffcd4-cd00-4292-a3a7-73ad45640574" released by "delete_volume" :: held 1.511s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:53 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-4b259932-6aa9-45af-9204-cd6993dd2f89 tempest-CreateVolumesFromImageTest-914352645 None] Created reservations ['a677e28b-13d8-43c0-98ee-591cdec00c88', '60694df8-fe55-456d-9d59-69533e2801a5', '4aac42bc-f600-4189-b338-65a8a32cade9', '5ce18ea0-736a-439c-b4c2-3e82551f5069'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:25:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4b259932-6aa9-45af-9204-cd6993dd2f89 tempest-CreateVolumesFromImageTest-914352645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4b259932-6aa9-45af-9204-cd6993dd2f89 tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:54 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4b259932-6aa9-45af-9204-cd6993dd2f89 tempest-CreateVolumesFromImageTest-914352645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:54 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4b259932-6aa9-45af-9204-cd6993dd2f89 tempest-CreateVolumesFromImageTest-914352645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4b259932-6aa9-45af-9204-cd6993dd2f89 tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4b259932-6aa9-45af-9204-cd6993dd2f89 tempest-CreateVolumesFromImageTest-914352645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:54 devstack sudo[104241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:25:54 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:54 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cb0c064f-0c2d-436c-8822-81691beea120 tempest-CreateVolumesFromImageTest-914352645 None] Acquiring lock "cinder-ee3e7e8a-6d20-4a55-b3fb-8557597a42d7-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:54 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cb0c064f-0c2d-436c-8822-81691beea120 tempest-CreateVolumesFromImageTest-914352645 None] Lock "cinder-ee3e7e8a-6d20-4a55-b3fb-8557597a42d7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:54 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cb0c064f-0c2d-436c-8822-81691beea120 tempest-CreateVolumesFromImageTest-914352645 None] Acquiring lock "cinder-quobyte-ee3e7e8a-6d20-4a55-b3fb-8557597a42d7" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:54 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cb0c064f-0c2d-436c-8822-81691beea120 tempest-CreateVolumesFromImageTest-914352645 None] Lock "cinder-quobyte-ee3e7e8a-6d20-4a55-b3fb-8557597a42d7" acquired by "delete_volume" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:54 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[570f86f1-e043-45d0-b9a9-5ff9664b7a26]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cb0c064f-0c2d-436c-8822-81691beea120 tempest-CreateVolumesFromImageTest-914352645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee3e7e8a-6d20-4a55-b3fb-8557597a42d7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:54 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4b259932-6aa9-45af-9204-cd6993dd2f89 tempest-CreateVolumesFromImageTest-914352645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.667s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:54 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-4b259932-6aa9-45af-9204-cd6993dd2f89 tempest-CreateVolumesFromImageTest-914352645 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:25:54 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-4b259932-6aa9-45af-9204-cd6993dd2f89 tempest-CreateVolumesFromImageTest-914352645 None] Deleted volume successfully. Jul 08 01:25:54 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4b259932-6aa9-45af-9204-cd6993dd2f89 tempest-CreateVolumesFromImageTest-914352645 None] Lock "cinder-c8fffcd4-cd00-4292-a3a7-73ad45640574-delete_volume" released by "delete_volume" :: held 2.393s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:54 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee3e7e8a-6d20-4a55-b3fb-8557597a42d7 Jul 08 01:25:54 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:55 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cb0c064f-0c2d-436c-8822-81691beea120 tempest-CreateVolumesFromImageTest-914352645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee3e7e8a-6d20-4a55-b3fb-8557597a42d7" returned: 0 in 0.755s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cb0c064f-0c2d-436c-8822-81691beea120 tempest-CreateVolumesFromImageTest-914352645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee3e7e8a-6d20-4a55-b3fb-8557597a42d7 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:55 devstack sudo[104249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee3e7e8a-6d20-4a55-b3fb-8557597a42d7 Jul 08 01:25:55 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:56 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cb0c064f-0c2d-436c-8822-81691beea120 tempest-CreateVolumesFromImageTest-914352645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee3e7e8a-6d20-4a55-b3fb-8557597a42d7" returned: 0 in 0.655s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cb0c064f-0c2d-436c-8822-81691beea120 tempest-CreateVolumesFromImageTest-914352645 None] Lock "cinder-quobyte-ee3e7e8a-6d20-4a55-b3fb-8557597a42d7" released by "delete_volume" :: held 1.447s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:56 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-cb0c064f-0c2d-436c-8822-81691beea120 tempest-CreateVolumesFromImageTest-914352645 None] Created reservations ['140e209b-f5de-4cdf-95ad-cb34b0e3cf11', 'ccaf67c2-81ec-47cc-a8c1-98571b5d23a3', '2a2099af-9f2d-4679-875b-fc09a07cbc84', 'aca0fc07-58b2-4f6b-9a05-fd49d061d282'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:25:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-cb0c064f-0c2d-436c-8822-81691beea120 tempest-CreateVolumesFromImageTest-914352645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-cb0c064f-0c2d-436c-8822-81691beea120 tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:56 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-cb0c064f-0c2d-436c-8822-81691beea120 tempest-CreateVolumesFromImageTest-914352645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:56 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-cb0c064f-0c2d-436c-8822-81691beea120 tempest-CreateVolumesFromImageTest-914352645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-cb0c064f-0c2d-436c-8822-81691beea120 tempest-CreateVolumesFromImageTest-914352645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cb0c064f-0c2d-436c-8822-81691beea120 tempest-CreateVolumesFromImageTest-914352645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:56 devstack sudo[104252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:25:56 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:56 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-cb0c064f-0c2d-436c-8822-81691beea120 tempest-CreateVolumesFromImageTest-914352645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.652s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:56 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-cb0c064f-0c2d-436c-8822-81691beea120 tempest-CreateVolumesFromImageTest-914352645 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:25:56 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-cb0c064f-0c2d-436c-8822-81691beea120 tempest-CreateVolumesFromImageTest-914352645 None] Deleted volume successfully. Jul 08 01:25:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-cb0c064f-0c2d-436c-8822-81691beea120 tempest-CreateVolumesFromImageTest-914352645 None] Lock "cinder-ee3e7e8a-6d20-4a55-b3fb-8557597a42d7-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:59 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:25:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Flow 'volume_create_manager' (a49f2186-7a0a-4df3-8ab1-3bf1e48a2e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24632ed1-d73d-4ec5-9cd3-cd1130e17470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24632ed1-d73d-4ec5-9cd3-cd1130e17470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1931847870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd29c3e6-a90c-4be6-8435-4b9f48412a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89110682c5d84b52a070a5161709424d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:00Z,use_quota=True,user_id='49d5e35f970d41b1b7d65d978de25bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79f5697e-b957-49ca-9fca-a93fa449a399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79f5697e-b957-49ca-9fca-a93fa449a399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c123ef3-43b2-428f-9bd7-906d71d0a793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c123ef3-43b2-428f-9bd7-906d71d0a793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd29c3e6-a90c-4be6-8435-4b9f48412a12', 'volume_name': 'volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5745d36-82e2-429d-b593-12e60ac9e6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5745d36-82e2-429d-b593-12e60ac9e6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc4dc34-cedb-44f7-8416-1c39bafacc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:59 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Volume fd29c3e6-a90c-4be6-8435-4b9f48412a12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12', 'volume_size': 1} Jul 08 01:25:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1931847870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd29c3e6-a90c-4be6-8435-4b9f48412a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89110682c5d84b52a070a5161709424d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:00Z,use_quota=True,user_id='49d5e35f970d41b1b7d65d978de25bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:25:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Creating volume fd29c3e6-a90c-4be6-8435-4b9f48412a12 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:25:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:25:59 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:25:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:59 devstack sudo[104256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12 1073741824 Jul 08 01:25:59 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:00 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12 1073741824" returned: 0 in 0.844s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:00 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12 Jul 08 01:26:00 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:01 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12" returned: 0 in 0.666s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:26:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc4dc34-cedb-44f7-8416-1c39bafacc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9adb3eb-ea41-458f-ba50-1152eac21046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:01 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Volume volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12 (fd29c3e6-a90c-4be6-8435-4b9f48412a12): created successfully Jul 08 01:26:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9adb3eb-ea41-458f-ba50-1152eac21046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Flow 'volume_create_manager' (a49f2186-7a0a-4df3-8ab1-3bf1e48a2e01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:01 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-19b3eb48-e36a-49cc-8544-f628db8e30ee tempest-CreateVolumesFromSnapshotTest-1448285247 None] Created volume successfully. Jul 08 01:26:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-73e0add6-b7df-4fa6-9f63-052f55f72b1b tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-73e0add6-b7df-4fa6-9f63-052f55f72b1b tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-73e0add6-b7df-4fa6-9f63-052f55f72b1b tempest-CreateVolumesFromSnapshotTest-1448285247 None] Creating offline snapshot e845ecf2-d110-40a3-97a6-1852c066809b of volume fd29c3e6-a90c-4be6-8435-4b9f48412a12 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:26:02 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[94415587-d0e0-40e0-adea-1d7f5153f634]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-73e0add6-b7df-4fa6-9f63-052f55f72b1b tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:02 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12 Jul 08 01:26:02 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:02 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-73e0add6-b7df-4fa6-9f63-052f55f72b1b tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12" returned: 0 in 0.805s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-73e0add6-b7df-4fa6-9f63-052f55f72b1b tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12.e845ecf2-d110-40a3-97a6-1852c066809b 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:02 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12.e845ecf2-d110-40a3-97a6-1852c066809b 1G Jul 08 01:26:02 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:03 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-73e0add6-b7df-4fa6-9f63-052f55f72b1b tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12.e845ecf2-d110-40a3-97a6-1852c066809b 1G" returned: 0 in 0.797s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-73e0add6-b7df-4fa6-9f63-052f55f72b1b tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12.e845ecf2-d110-40a3-97a6-1852c066809b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:03 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12.e845ecf2-d110-40a3-97a6-1852c066809b Jul 08 01:26:03 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:04 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-73e0add6-b7df-4fa6-9f63-052f55f72b1b tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12.e845ecf2-d110-40a3-97a6-1852c066809b" returned: 0 in 0.687s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:04 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-73e0add6-b7df-4fa6-9f63-052f55f72b1b tempest-CreateVolumesFromSnapshotTest-1448285247 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12.e845ecf2-d110-40a3-97a6-1852c066809b is being set with open permissions: ugo+rw Jul 08 01:26:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-73e0add6-b7df-4fa6-9f63-052f55f72b1b tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12.e845ecf2-d110-40a3-97a6-1852c066809b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:04 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12.e845ecf2-d110-40a3-97a6-1852c066809b Jul 08 01:26:04 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:04 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-73e0add6-b7df-4fa6-9f63-052f55f72b1b tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12.e845ecf2-d110-40a3-97a6-1852c066809b" returned: 0 in 0.666s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-73e0add6-b7df-4fa6-9f63-052f55f72b1b tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:05 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12.info Jul 08 01:26:05 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:05 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-73e0add6-b7df-4fa6-9f63-052f55f72b1b tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12.info" returned: 0 in 0.671s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:05 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-73e0add6-b7df-4fa6-9f63-052f55f72b1b tempest-CreateVolumesFromSnapshotTest-1448285247 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12.info is being set with open permissions: ugo+rw Jul 08 01:26:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-73e0add6-b7df-4fa6-9f63-052f55f72b1b tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:05 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12.info Jul 08 01:26:05 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:06 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-73e0add6-b7df-4fa6-9f63-052f55f72b1b tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12.info" returned: 0 in 0.653s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-73e0add6-b7df-4fa6-9f63-052f55f72b1b tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.376s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:06 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-73e0add6-b7df-4fa6-9f63-052f55f72b1b tempest-CreateVolumesFromSnapshotTest-1448285247 None] Create snapshot completed successfully Jul 08 01:26:07 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:26:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Flow 'volume_create_manager' (c2d0855a-1c69-4ad3-8707-34da0350fc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5a0ff3d-fde2-4a84-a085-860a05f7f51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5a0ff3d-fde2-4a84-a085-860a05f7f51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-565887119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb35ced5-1f3a-4d35-905d-ee5201dfa99a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89110682c5d84b52a070a5161709424d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:08Z,use_quota=True,user_id='49d5e35f970d41b1b7d65d978de25bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e2f4976-90cf-46bd-b9c2-f3b2be8dfc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e2f4976-90cf-46bd-b9c2-f3b2be8dfc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (672ce5ab-ab01-4071-9500-6a058ce1695d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (672ce5ab-ab01-4071-9500-6a058ce1695d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb35ced5-1f3a-4d35-905d-ee5201dfa99a', 'volume_name': 'volume-fb35ced5-1f3a-4d35-905d-ee5201dfa99a', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46dce0c9-f1b1-47f7-b230-45ba4383a850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46dce0c9-f1b1-47f7-b230-45ba4383a850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034ef70e-d760-4273-b9c7-121531152b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:07 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Volume fb35ced5-1f3a-4d35-905d-ee5201dfa99a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb35ced5-1f3a-4d35-905d-ee5201dfa99a', 'volume_size': 1} Jul 08 01:26:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:07 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-565887119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb35ced5-1f3a-4d35-905d-ee5201dfa99a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89110682c5d84b52a070a5161709424d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:08Z,use_quota=True,user_id='49d5e35f970d41b1b7d65d978de25bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:26:07 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Creating volume fb35ced5-1f3a-4d35-905d-ee5201dfa99a {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:26:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:07 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:07 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:07 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:26:07 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:26:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb35ced5-1f3a-4d35-905d-ee5201dfa99a 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:07 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb35ced5-1f3a-4d35-905d-ee5201dfa99a 1073741824 Jul 08 01:26:07 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:07 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:26:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Flow 'volume_create_manager' (5daf5fa8-ecd7-412e-9202-14ade8c9f6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:07 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (411aabeb-15db-4036-ba15-0a9c1573cb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (411aabeb-15db-4036-ba15-0a9c1573cb93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1094808757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1b6848c-c5e2-48ca-a5cc-30e33b64a476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89110682c5d84b52a070a5161709424d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:08Z,use_quota=True,user_id='49d5e35f970d41b1b7d65d978de25bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3cf6438-e435-46b8-89f3-7b00253dc3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3cf6438-e435-46b8-89f3-7b00253dc3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ba5801-a7ef-4e9c-a768-0f4a5cdb5caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ba5801-a7ef-4e9c-a768-0f4a5cdb5caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1b6848c-c5e2-48ca-a5cc-30e33b64a476', 'volume_name': 'volume-a1b6848c-c5e2-48ca-a5cc-30e33b64a476', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af98cb7b-1521-4f69-bda0-5ba17d960fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af98cb7b-1521-4f69-bda0-5ba17d960fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c20533a-65da-4784-ae89-79a89107cef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:08 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Volume a1b6848c-c5e2-48ca-a5cc-30e33b64a476: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1b6848c-c5e2-48ca-a5cc-30e33b64a476', 'volume_size': 1} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Flow 'volume_create_manager' (4c6c8e38-6004-4954-82ac-a2a036c5a277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471b112b-040c-4205-b521-40ec4159cdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471b112b-040c-4205-b521-40ec4159cdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-275378039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1861892-b2c9-48b1-9006-3ece214d24fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89110682c5d84b52a070a5161709424d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:08Z,use_quota=True,user_id='49d5e35f970d41b1b7d65d978de25bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712a87f9-8951-4326-811a-28c0f4f98a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712a87f9-8951-4326-811a-28c0f4f98a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd3e6d9e-dbb8-4d11-9fe0-ab75dea863bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd3e6d9e-dbb8-4d11-9fe0-ab75dea863bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1861892-b2c9-48b1-9006-3ece214d24fc', 'volume_name': 'volume-e1861892-b2c9-48b1-9006-3ece214d24fc', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df95e557-ac96-4d41-8b9d-f0ff4e343359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df95e557-ac96-4d41-8b9d-f0ff4e343359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2439aab-de02-481a-a52b-ab3b9c2b7850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:08 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Volume e1861892-b2c9-48b1-9006-3ece214d24fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1861892-b2c9-48b1-9006-3ece214d24fc', 'volume_size': 1} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:08 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb35ced5-1f3a-4d35-905d-ee5201dfa99a 1073741824" returned: 0 in 0.950s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb35ced5-1f3a-4d35-905d-ee5201dfa99a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:08 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb35ced5-1f3a-4d35-905d-ee5201dfa99a Jul 08 01:26:08 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Flow 'volume_create_manager' (0260727c-318b-4d62-93a8-b874dd8d1568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b254b85a-3e61-4a96-9e9e-0f8126723c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b254b85a-3e61-4a96-9e9e-0f8126723c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1775134836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0524224-cef5-4d18-8f22-a344bfc016f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89110682c5d84b52a070a5161709424d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:09Z,use_quota=True,user_id='49d5e35f970d41b1b7d65d978de25bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c76b0f-2fba-4680-a13d-9dd979857586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c76b0f-2fba-4680-a13d-9dd979857586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15377c21-4e7c-4fa7-a319-5766da90e178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15377c21-4e7c-4fa7-a319-5766da90e178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0524224-cef5-4d18-8f22-a344bfc016f0', 'volume_name': 'volume-f0524224-cef5-4d18-8f22-a344bfc016f0', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c66d5bc-9e83-4a64-98a8-3b992431a9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c66d5bc-9e83-4a64-98a8-3b992431a9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0289cec-5fde-47d1-b61b-90e4d3e3f1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:08 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Volume f0524224-cef5-4d18-8f22-a344bfc016f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0524224-cef5-4d18-8f22-a344bfc016f0', 'volume_size': 1} Jul 08 01:26:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:09 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:26:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Flow 'volume_create_manager' (3a255d48-42f8-46e6-a0b8-5fc898c3be10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79fe0d82-ddf9-4c33-98a6-5a25663b1051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79fe0d82-ddf9-4c33-98a6-5a25663b1051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1060101862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6a4aa9-a7f4-412b-81df-bf7045a11e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89110682c5d84b52a070a5161709424d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:09Z,use_quota=True,user_id='49d5e35f970d41b1b7d65d978de25bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (799b41e8-1f38-46fe-8c1c-46e2f75c3f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (799b41e8-1f38-46fe-8c1c-46e2f75c3f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a8ec890-f26e-401a-ad33-c248d42b2251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a8ec890-f26e-401a-ad33-c248d42b2251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe6a4aa9-a7f4-412b-81df-bf7045a11e87', 'volume_name': 'volume-fe6a4aa9-a7f4-412b-81df-bf7045a11e87', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1db7652-11ab-473b-8901-2cb827b2de1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1db7652-11ab-473b-8901-2cb827b2de1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fe4fc58-27c2-4093-b1e7-a756a38b8edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:09 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Volume fe6a4aa9-a7f4-412b-81df-bf7045a11e87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe6a4aa9-a7f4-412b-81df-bf7045a11e87', 'volume_size': 1} Jul 08 01:26:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:09 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb35ced5-1f3a-4d35-905d-ee5201dfa99a" returned: 0 in 0.702s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:26:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.326s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1094808757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1b6848c-c5e2-48ca-a5cc-30e33b64a476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89110682c5d84b52a070a5161709424d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:08Z,use_quota=True,user_id='49d5e35f970d41b1b7d65d978de25bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:26:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Creating volume a1b6848c-c5e2-48ca-a5cc-30e33b64a476 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:26:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:26:09 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:26:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a1b6848c-c5e2-48ca-a5cc-30e33b64a476 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:09 devstack sudo[104301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a1b6848c-c5e2-48ca-a5cc-30e33b64a476 1073741824 Jul 08 01:26:09 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034ef70e-d760-4273-b9c7-121531152b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb35ced5-1f3a-4d35-905d-ee5201dfa99a', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b5d54c-2f6e-47e6-bbb7-89d58ec470e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:09 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Volume volume-fb35ced5-1f3a-4d35-905d-ee5201dfa99a (fb35ced5-1f3a-4d35-905d-ee5201dfa99a): created successfully Jul 08 01:26:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b5d54c-2f6e-47e6-bbb7-89d58ec470e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Flow 'volume_create_manager' (c2d0855a-1c69-4ad3-8707-34da0350fc3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:09 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-b04099a2-9542-4a20-b597-9287ac5e914c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Created volume successfully. Jul 08 01:26:10 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a1b6848c-c5e2-48ca-a5cc-30e33b64a476 1073741824" returned: 0 in 0.845s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a1b6848c-c5e2-48ca-a5cc-30e33b64a476 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:10 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a1b6848c-c5e2-48ca-a5cc-30e33b64a476 Jul 08 01:26:10 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:10 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a1b6848c-c5e2-48ca-a5cc-30e33b64a476" returned: 0 in 0.651s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:26:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.458s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-275378039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1861892-b2c9-48b1-9006-3ece214d24fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89110682c5d84b52a070a5161709424d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:08Z,use_quota=True,user_id='49d5e35f970d41b1b7d65d978de25bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:26:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Creating volume e1861892-b2c9-48b1-9006-3ece214d24fc {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:26:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:26:10 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:26:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e1861892-b2c9-48b1-9006-3ece214d24fc 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:10 devstack sudo[104313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e1861892-b2c9-48b1-9006-3ece214d24fc 1073741824 Jul 08 01:26:10 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:10 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c20533a-65da-4784-ae89-79a89107cef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1b6848c-c5e2-48ca-a5cc-30e33b64a476', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:10 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c073a5fd-5b31-4f4c-bc06-c492aedcd798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:10 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Volume volume-a1b6848c-c5e2-48ca-a5cc-30e33b64a476 (a1b6848c-c5e2-48ca-a5cc-30e33b64a476): created successfully Jul 08 01:26:10 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c073a5fd-5b31-4f4c-bc06-c492aedcd798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:10 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Flow 'volume_create_manager' (5daf5fa8-ecd7-412e-9202-14ade8c9f6e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:10 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-e660abf9-db6f-4c55-b052-551a78476d4e tempest-CreateVolumesFromSnapshotTest-1448285247 None] Created volume successfully. Jul 08 01:26:11 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e1861892-b2c9-48b1-9006-3ece214d24fc 1073741824" returned: 0 in 0.824s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e1861892-b2c9-48b1-9006-3ece214d24fc {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:11 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e1861892-b2c9-48b1-9006-3ece214d24fc Jul 08 01:26:11 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:12 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e1861892-b2c9-48b1-9006-3ece214d24fc" returned: 0 in 0.634s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:12 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:26:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.555s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:12 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1775134836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0524224-cef5-4d18-8f22-a344bfc016f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89110682c5d84b52a070a5161709424d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:09Z,use_quota=True,user_id='49d5e35f970d41b1b7d65d978de25bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:26:12 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Creating volume f0524224-cef5-4d18-8f22-a344bfc016f0 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:26:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:12 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:12 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:12 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:26:12 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:26:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f0524224-cef5-4d18-8f22-a344bfc016f0 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2439aab-de02-481a-a52b-ab3b9c2b7850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1861892-b2c9-48b1-9006-3ece214d24fc', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:12 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f0524224-cef5-4d18-8f22-a344bfc016f0 1073741824 Jul 08 01:26:12 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa7d3fe-0a26-43b4-a362-c04c912ff5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:12 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Volume volume-e1861892-b2c9-48b1-9006-3ece214d24fc (e1861892-b2c9-48b1-9006-3ece214d24fc): created successfully Jul 08 01:26:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa7d3fe-0a26-43b4-a362-c04c912ff5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Flow 'volume_create_manager' (4c6c8e38-6004-4954-82ac-a2a036c5a277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:12 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-8e809ae4-1c34-493a-bc10-3e85d76fe5e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Created volume successfully. Jul 08 01:26:13 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f0524224-cef5-4d18-8f22-a344bfc016f0 1073741824" returned: 0 in 0.800s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f0524224-cef5-4d18-8f22-a344bfc016f0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:13 devstack sudo[104326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f0524224-cef5-4d18-8f22-a344bfc016f0 Jul 08 01:26:13 devstack sudo[104326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:13 devstack sudo[104326]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f0524224-cef5-4d18-8f22-a344bfc016f0" returned: 0 in 0.621s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:26:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.709s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1060101862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6a4aa9-a7f4-412b-81df-bf7045a11e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89110682c5d84b52a070a5161709424d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:09Z,use_quota=True,user_id='49d5e35f970d41b1b7d65d978de25bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:26:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Creating volume fe6a4aa9-a7f4-412b-81df-bf7045a11e87 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:26:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:26:13 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:26:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fe6a4aa9-a7f4-412b-81df-bf7045a11e87 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:13 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fe6a4aa9-a7f4-412b-81df-bf7045a11e87 1073741824 Jul 08 01:26:13 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0289cec-5fde-47d1-b61b-90e4d3e3f1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0524224-cef5-4d18-8f22-a344bfc016f0', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524a44d9-b453-4cb9-8baa-e46b9b0561fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:13 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Volume volume-f0524224-cef5-4d18-8f22-a344bfc016f0 (f0524224-cef5-4d18-8f22-a344bfc016f0): created successfully Jul 08 01:26:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524a44d9-b453-4cb9-8baa-e46b9b0561fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Flow 'volume_create_manager' (0260727c-318b-4d62-93a8-b874dd8d1568) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:14 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-f37d2f26-2ac2-44c2-afa6-11e7019a5403 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Created volume successfully. Jul 08 01:26:14 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fe6a4aa9-a7f4-412b-81df-bf7045a11e87 1073741824" returned: 0 in 0.859s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fe6a4aa9-a7f4-412b-81df-bf7045a11e87 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:14 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fe6a4aa9-a7f4-412b-81df-bf7045a11e87 Jul 08 01:26:14 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:15 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fe6a4aa9-a7f4-412b-81df-bf7045a11e87" returned: 0 in 0.647s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:15 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:26:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fe4fc58-27c2-4093-b1e7-a756a38b8edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe6a4aa9-a7f4-412b-81df-bf7045a11e87', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b60b12-b74d-4a2b-a9d6-fd9963664662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:15 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Volume volume-fe6a4aa9-a7f4-412b-81df-bf7045a11e87 (fe6a4aa9-a7f4-412b-81df-bf7045a11e87): created successfully Jul 08 01:26:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b60b12-b74d-4a2b-a9d6-fd9963664662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Flow 'volume_create_manager' (3a255d48-42f8-46e6-a0b8-5fc898c3be10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:15 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-ccb73f41-9656-44f7-a017-5aa543247b22 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Created volume successfully. Jul 08 01:26:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-54b22844-78fc-47f7-af47-d07043e50ec2 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "cinder-fe6a4aa9-a7f4-412b-81df-bf7045a11e87-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-54b22844-78fc-47f7-af47-d07043e50ec2 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-fe6a4aa9-a7f4-412b-81df-bf7045a11e87-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-54b22844-78fc-47f7-af47-d07043e50ec2 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "cinder-quobyte-fe6a4aa9-a7f4-412b-81df-bf7045a11e87" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-54b22844-78fc-47f7-af47-d07043e50ec2 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-quobyte-fe6a4aa9-a7f4-412b-81df-bf7045a11e87" acquired by "delete_volume" :: waited 0.014s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:15 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d568129-35c8-460a-847d-766eb1fe8b85]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-54b22844-78fc-47f7-af47-d07043e50ec2 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fe6a4aa9-a7f4-412b-81df-bf7045a11e87 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:16 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fe6a4aa9-a7f4-412b-81df-bf7045a11e87 Jul 08 01:26:16 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:16 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-54b22844-78fc-47f7-af47-d07043e50ec2 tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fe6a4aa9-a7f4-412b-81df-bf7045a11e87" returned: 0 in 0.754s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-54b22844-78fc-47f7-af47-d07043e50ec2 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fe6a4aa9-a7f4-412b-81df-bf7045a11e87 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:16 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fe6a4aa9-a7f4-412b-81df-bf7045a11e87 Jul 08 01:26:16 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:17 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-54b22844-78fc-47f7-af47-d07043e50ec2 tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fe6a4aa9-a7f4-412b-81df-bf7045a11e87" returned: 0 in 0.653s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:17 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-54b22844-78fc-47f7-af47-d07043e50ec2 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-quobyte-fe6a4aa9-a7f4-412b-81df-bf7045a11e87" released by "delete_volume" :: held 1.447s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:17 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-54b22844-78fc-47f7-af47-d07043e50ec2 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Created reservations ['d82fb954-39e8-4e06-bcb4-e468326dc755', '2050c95d-721f-4b8c-a6de-a1ef0832ee9c', '79d77188-93e3-4e66-b55b-3f8b72625258', 'cfa2c040-035f-459d-9d20-81a7c6bb16f7'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:26:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-54b22844-78fc-47f7-af47-d07043e50ec2 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-54b22844-78fc-47f7-af47-d07043e50ec2 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-54b22844-78fc-47f7-af47-d07043e50ec2 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-54b22844-78fc-47f7-af47-d07043e50ec2 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-54b22844-78fc-47f7-af47-d07043e50ec2 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-54b22844-78fc-47f7-af47-d07043e50ec2 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:17 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:26:17 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-aa2035aa-e32e-4acb-912d-ff8a35267308 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "cinder-f0524224-cef5-4d18-8f22-a344bfc016f0-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-aa2035aa-e32e-4acb-912d-ff8a35267308 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-f0524224-cef5-4d18-8f22-a344bfc016f0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-aa2035aa-e32e-4acb-912d-ff8a35267308 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "cinder-quobyte-f0524224-cef5-4d18-8f22-a344bfc016f0" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-aa2035aa-e32e-4acb-912d-ff8a35267308 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-quobyte-f0524224-cef5-4d18-8f22-a344bfc016f0" acquired by "delete_volume" :: waited 0.028s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:18 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-54b22844-78fc-47f7-af47-d07043e50ec2 tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.721s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:18 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-54b22844-78fc-47f7-af47-d07043e50ec2 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:26:18 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b6747a-7db2-451f-a745-a3abc10cd0f8]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-aa2035aa-e32e-4acb-912d-ff8a35267308 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f0524224-cef5-4d18-8f22-a344bfc016f0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:18 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-54b22844-78fc-47f7-af47-d07043e50ec2 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Deleted volume successfully. Jul 08 01:26:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-54b22844-78fc-47f7-af47-d07043e50ec2 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-fe6a4aa9-a7f4-412b-81df-bf7045a11e87-delete_volume" released by "delete_volume" :: held 2.405s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:18 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f0524224-cef5-4d18-8f22-a344bfc016f0 Jul 08 01:26:18 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:18 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-aa2035aa-e32e-4acb-912d-ff8a35267308 tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f0524224-cef5-4d18-8f22-a344bfc016f0" returned: 0 in 0.801s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-aa2035aa-e32e-4acb-912d-ff8a35267308 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f0524224-cef5-4d18-8f22-a344bfc016f0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:19 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f0524224-cef5-4d18-8f22-a344bfc016f0 Jul 08 01:26:19 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:19 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-aa2035aa-e32e-4acb-912d-ff8a35267308 tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f0524224-cef5-4d18-8f22-a344bfc016f0" returned: 0 in 0.659s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-aa2035aa-e32e-4acb-912d-ff8a35267308 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-quobyte-f0524224-cef5-4d18-8f22-a344bfc016f0" released by "delete_volume" :: held 1.505s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:19 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-aa2035aa-e32e-4acb-912d-ff8a35267308 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Created reservations ['698a8107-c79a-4108-8ac3-8c2104554fae', 'a5c4addb-e00f-4d20-9180-cd722fc1ac88', '27beac08-d148-409a-b8db-e2840ce9b2ab', '05d7c22c-9ca4-4a39-b702-42f0ce30750a'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:26:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-aa2035aa-e32e-4acb-912d-ff8a35267308 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-aa2035aa-e32e-4acb-912d-ff8a35267308 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-aa2035aa-e32e-4acb-912d-ff8a35267308 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-aa2035aa-e32e-4acb-912d-ff8a35267308 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-aa2035aa-e32e-4acb-912d-ff8a35267308 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-aa2035aa-e32e-4acb-912d-ff8a35267308 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:19 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:26:19 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-699dce13-94df-49a6-be07-d1d0dd99c554 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "cinder-e1861892-b2c9-48b1-9006-3ece214d24fc-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-699dce13-94df-49a6-be07-d1d0dd99c554 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-e1861892-b2c9-48b1-9006-3ece214d24fc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-699dce13-94df-49a6-be07-d1d0dd99c554 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "cinder-quobyte-e1861892-b2c9-48b1-9006-3ece214d24fc" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-699dce13-94df-49a6-be07-d1d0dd99c554 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-quobyte-e1861892-b2c9-48b1-9006-3ece214d24fc" acquired by "delete_volume" :: waited 0.015s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:20 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dde8da-f199-46e0-9487-3040f5ff770c]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-699dce13-94df-49a6-be07-d1d0dd99c554 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e1861892-b2c9-48b1-9006-3ece214d24fc {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:20 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-aa2035aa-e32e-4acb-912d-ff8a35267308 tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.748s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:20 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-aa2035aa-e32e-4acb-912d-ff8a35267308 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:26:20 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-aa2035aa-e32e-4acb-912d-ff8a35267308 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Deleted volume successfully. Jul 08 01:26:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-aa2035aa-e32e-4acb-912d-ff8a35267308 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-f0524224-cef5-4d18-8f22-a344bfc016f0-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:20 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e1861892-b2c9-48b1-9006-3ece214d24fc Jul 08 01:26:20 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:21 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-699dce13-94df-49a6-be07-d1d0dd99c554 tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e1861892-b2c9-48b1-9006-3ece214d24fc" returned: 0 in 0.768s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-699dce13-94df-49a6-be07-d1d0dd99c554 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e1861892-b2c9-48b1-9006-3ece214d24fc {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:21 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e1861892-b2c9-48b1-9006-3ece214d24fc Jul 08 01:26:21 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:21 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-699dce13-94df-49a6-be07-d1d0dd99c554 tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e1861892-b2c9-48b1-9006-3ece214d24fc" returned: 0 in 0.647s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:21 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-699dce13-94df-49a6-be07-d1d0dd99c554 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-quobyte-e1861892-b2c9-48b1-9006-3ece214d24fc" released by "delete_volume" :: held 1.457s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:21 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-699dce13-94df-49a6-be07-d1d0dd99c554 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Created reservations ['2b7dae30-3d8b-47fa-b11f-cbecad61563b', '455e9c83-e2d4-4524-a78c-c58ddc7b8010', 'c965cbf8-e7d6-41cf-a4e4-e5e85effb887', '56d15a42-5416-4549-856a-d03464e57f27'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:26:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-699dce13-94df-49a6-be07-d1d0dd99c554 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-699dce13-94df-49a6-be07-d1d0dd99c554 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-699dce13-94df-49a6-be07-d1d0dd99c554 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-699dce13-94df-49a6-be07-d1d0dd99c554 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-699dce13-94df-49a6-be07-d1d0dd99c554 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-699dce13-94df-49a6-be07-d1d0dd99c554 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:22 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:26:22 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c37739ac-81e2-40c3-be51-68108500c4f5 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "cinder-a1b6848c-c5e2-48ca-a5cc-30e33b64a476-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c37739ac-81e2-40c3-be51-68108500c4f5 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-a1b6848c-c5e2-48ca-a5cc-30e33b64a476-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c37739ac-81e2-40c3-be51-68108500c4f5 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "cinder-quobyte-a1b6848c-c5e2-48ca-a5cc-30e33b64a476" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c37739ac-81e2-40c3-be51-68108500c4f5 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-quobyte-a1b6848c-c5e2-48ca-a5cc-30e33b64a476" acquired by "delete_volume" :: waited 0.016s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:22 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b92c53-6b5e-4cd9-bc81-4327a6252666]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c37739ac-81e2-40c3-be51-68108500c4f5 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a1b6848c-c5e2-48ca-a5cc-30e33b64a476 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:22 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-699dce13-94df-49a6-be07-d1d0dd99c554 tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.736s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:22 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-699dce13-94df-49a6-be07-d1d0dd99c554 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:26:22 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-699dce13-94df-49a6-be07-d1d0dd99c554 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Deleted volume successfully. Jul 08 01:26:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-699dce13-94df-49a6-be07-d1d0dd99c554 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-e1861892-b2c9-48b1-9006-3ece214d24fc-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:22 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a1b6848c-c5e2-48ca-a5cc-30e33b64a476 Jul 08 01:26:22 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:23 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c37739ac-81e2-40c3-be51-68108500c4f5 tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a1b6848c-c5e2-48ca-a5cc-30e33b64a476" returned: 0 in 0.754s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c37739ac-81e2-40c3-be51-68108500c4f5 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a1b6848c-c5e2-48ca-a5cc-30e33b64a476 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:23 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a1b6848c-c5e2-48ca-a5cc-30e33b64a476 Jul 08 01:26:23 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:24 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c37739ac-81e2-40c3-be51-68108500c4f5 tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a1b6848c-c5e2-48ca-a5cc-30e33b64a476" returned: 0 in 0.623s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c37739ac-81e2-40c3-be51-68108500c4f5 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-quobyte-a1b6848c-c5e2-48ca-a5cc-30e33b64a476" released by "delete_volume" :: held 1.436s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:24 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-c37739ac-81e2-40c3-be51-68108500c4f5 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Created reservations ['046a5ee3-b09b-48f1-b53c-9a688ca9e50a', '502b9c8d-8165-45f0-ac08-c29c72d35fbe', 'a02943bc-0064-4365-9158-6250febfbd4d', '55844ba0-a90e-4139-975c-3e43a9420f9f'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:26:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c37739ac-81e2-40c3-be51-68108500c4f5 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c37739ac-81e2-40c3-be51-68108500c4f5 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c37739ac-81e2-40c3-be51-68108500c4f5 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c37739ac-81e2-40c3-be51-68108500c4f5 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c37739ac-81e2-40c3-be51-68108500c4f5 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c37739ac-81e2-40c3-be51-68108500c4f5 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:24 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:26:24 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-25888175-e3bf-4675-8d32-4d39e885e6e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "cinder-fb35ced5-1f3a-4d35-905d-ee5201dfa99a-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-25888175-e3bf-4675-8d32-4d39e885e6e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-fb35ced5-1f3a-4d35-905d-ee5201dfa99a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:24 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-25888175-e3bf-4675-8d32-4d39e885e6e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "cinder-quobyte-fb35ced5-1f3a-4d35-905d-ee5201dfa99a" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c37739ac-81e2-40c3-be51-68108500c4f5 tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.662s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:24 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-c37739ac-81e2-40c3-be51-68108500c4f5 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:26:24 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-c37739ac-81e2-40c3-be51-68108500c4f5 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Deleted volume successfully. Jul 08 01:26:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-25888175-e3bf-4675-8d32-4d39e885e6e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-quobyte-fb35ced5-1f3a-4d35-905d-ee5201dfa99a" acquired by "delete_volume" :: waited 0.028s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c37739ac-81e2-40c3-be51-68108500c4f5 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-a1b6848c-c5e2-48ca-a5cc-30e33b64a476-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:24 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa877c7-56f6-4db6-8967-fa3df7900d7d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-25888175-e3bf-4675-8d32-4d39e885e6e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb35ced5-1f3a-4d35-905d-ee5201dfa99a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:25 devstack sudo[104425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb35ced5-1f3a-4d35-905d-ee5201dfa99a Jul 08 01:26:25 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:25 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-25888175-e3bf-4675-8d32-4d39e885e6e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb35ced5-1f3a-4d35-905d-ee5201dfa99a" returned: 0 in 0.786s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-25888175-e3bf-4675-8d32-4d39e885e6e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb35ced5-1f3a-4d35-905d-ee5201dfa99a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:25 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb35ced5-1f3a-4d35-905d-ee5201dfa99a Jul 08 01:26:25 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:26 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-25888175-e3bf-4675-8d32-4d39e885e6e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fb35ced5-1f3a-4d35-905d-ee5201dfa99a" returned: 0 in 0.614s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:26 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-25888175-e3bf-4675-8d32-4d39e885e6e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-quobyte-fb35ced5-1f3a-4d35-905d-ee5201dfa99a" released by "delete_volume" :: held 1.441s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:26 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-25888175-e3bf-4675-8d32-4d39e885e6e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Created reservations ['9663183d-af32-4190-9290-bcf5ba07050e', '3dfb0613-19e0-4ca7-9876-45cd2c1c93b8', '672ac5b8-4f21-4c2a-bcb8-a75d7ddceef1', '71cb3579-3836-44a8-959c-e901b0611664'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:26:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-25888175-e3bf-4675-8d32-4d39e885e6e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-25888175-e3bf-4675-8d32-4d39e885e6e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:26 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-25888175-e3bf-4675-8d32-4d39e885e6e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:26 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-25888175-e3bf-4675-8d32-4d39e885e6e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-25888175-e3bf-4675-8d32-4d39e885e6e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-25888175-e3bf-4675-8d32-4d39e885e6e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:26 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:26:26 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7ef7c144-cbf0-486c-a7f0-da69d9804b2c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "cinder-e845ecf2-d110-40a3-97a6-1852c066809b-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7ef7c144-cbf0-486c-a7f0-da69d9804b2c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-e845ecf2-d110-40a3-97a6-1852c066809b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7ef7c144-cbf0-486c-a7f0-da69d9804b2c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "cinder-quobyte-fd29c3e6-a90c-4be6-8435-4b9f48412a12" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7ef7c144-cbf0-486c-a7f0-da69d9804b2c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-quobyte-fd29c3e6-a90c-4be6-8435-4b9f48412a12" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7ef7c144-cbf0-486c-a7f0-da69d9804b2c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "cinder-quobyte-e845ecf2-d110-40a3-97a6-1852c066809b" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7ef7c144-cbf0-486c-a7f0-da69d9804b2c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-quobyte-e845ecf2-d110-40a3-97a6-1852c066809b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:27 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-7ef7c144-cbf0-486c-a7f0-da69d9804b2c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Deleting offline snapshot e845ecf2-d110-40a3-97a6-1852c066809b of volume fd29c3e6-a90c-4be6-8435-4b9f48412a12 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:26:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-7ef7c144-cbf0-486c-a7f0-da69d9804b2c tempest-CreateVolumesFromSnapshotTest-1448285247 None] snapshot_file for this snap is: volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12.e845ecf2-d110-40a3-97a6-1852c066809b {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:26:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-25888175-e3bf-4675-8d32-4d39e885e6e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.678s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:27 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-25888175-e3bf-4675-8d32-4d39e885e6e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:26:27 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-25888175-e3bf-4675-8d32-4d39e885e6e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Deleted volume successfully. Jul 08 01:26:27 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[156218f1-5387-4fd5-8b3c-406e47ce66a9]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7ef7c144-cbf0-486c-a7f0-da69d9804b2c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12.e845ecf2-d110-40a3-97a6-1852c066809b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-25888175-e3bf-4675-8d32-4d39e885e6e8 tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-fb35ced5-1f3a-4d35-905d-ee5201dfa99a-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:27 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12.e845ecf2-d110-40a3-97a6-1852c066809b Jul 08 01:26:27 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:27 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7ef7c144-cbf0-486c-a7f0-da69d9804b2c tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12.e845ecf2-d110-40a3-97a6-1852c066809b" returned: 0 in 0.760s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-7ef7c144-cbf0-486c-a7f0-da69d9804b2c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:26:27 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f9073d-6766-49b8-a261-adc00bac54bc]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7ef7c144-cbf0-486c-a7f0-da69d9804b2c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:28 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12 Jul 08 01:26:28 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:28 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7ef7c144-cbf0-486c-a7f0-da69d9804b2c tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12" returned: 0 in 0.742s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7ef7c144-cbf0-486c-a7f0-da69d9804b2c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12.e845ecf2-d110-40a3-97a6-1852c066809b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:28 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12.e845ecf2-d110-40a3-97a6-1852c066809b Jul 08 01:26:28 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:29 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7ef7c144-cbf0-486c-a7f0-da69d9804b2c tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12.e845ecf2-d110-40a3-97a6-1852c066809b" returned: 0 in 0.769s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7ef7c144-cbf0-486c-a7f0-da69d9804b2c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12.e845ecf2-d110-40a3-97a6-1852c066809b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:29 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12.e845ecf2-d110-40a3-97a6-1852c066809b Jul 08 01:26:29 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:30 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7ef7c144-cbf0-486c-a7f0-da69d9804b2c tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12.e845ecf2-d110-40a3-97a6-1852c066809b" returned: 0 in 0.683s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:30 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7ef7c144-cbf0-486c-a7f0-da69d9804b2c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-quobyte-e845ecf2-d110-40a3-97a6-1852c066809b" released by "_delete_snapshot" :: held 3.066s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:30 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7ef7c144-cbf0-486c-a7f0-da69d9804b2c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-quobyte-fd29c3e6-a90c-4be6-8435-4b9f48412a12" released by "delete_snapshot" :: held 3.094s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:30 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-7ef7c144-cbf0-486c-a7f0-da69d9804b2c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Created reservations ['2cd77282-f6fa-41cb-91bf-26c84c8c7bd1', 'd2d94f00-1c46-452a-b611-6cbaac00c1b6', 'a74a0596-1617-4a14-a522-ac756f83c375', 'c8ea41a7-8cc6-46d6-a624-2b871ffe407e'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:26:30 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-7ef7c144-cbf0-486c-a7f0-da69d9804b2c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Delete snapshot completed successfully. Jul 08 01:26:30 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7ef7c144-cbf0-486c-a7f0-da69d9804b2c tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-e845ecf2-d110-40a3-97a6-1852c066809b-delete_snapshot" released by "delete_snapshot" :: held 3.243s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-11fe9ab4-e996-4add-9ff2-8bae39e4362d tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "cinder-fd29c3e6-a90c-4be6-8435-4b9f48412a12-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-11fe9ab4-e996-4add-9ff2-8bae39e4362d tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-fd29c3e6-a90c-4be6-8435-4b9f48412a12-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-11fe9ab4-e996-4add-9ff2-8bae39e4362d tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "cinder-quobyte-fd29c3e6-a90c-4be6-8435-4b9f48412a12" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-11fe9ab4-e996-4add-9ff2-8bae39e4362d tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-quobyte-fd29c3e6-a90c-4be6-8435-4b9f48412a12" acquired by "delete_volume" :: waited 0.015s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:31 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecee0abb-173b-4808-a51d-a0288d7815c5]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-11fe9ab4-e996-4add-9ff2-8bae39e4362d tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:31 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12 Jul 08 01:26:31 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:32 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-11fe9ab4-e996-4add-9ff2-8bae39e4362d tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12" returned: 0 in 0.787s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-11fe9ab4-e996-4add-9ff2-8bae39e4362d tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:32 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12 Jul 08 01:26:32 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:32 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-11fe9ab4-e996-4add-9ff2-8bae39e4362d tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fd29c3e6-a90c-4be6-8435-4b9f48412a12" returned: 0 in 0.668s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:32 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-11fe9ab4-e996-4add-9ff2-8bae39e4362d tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-quobyte-fd29c3e6-a90c-4be6-8435-4b9f48412a12" released by "delete_volume" :: held 1.517s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:32 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-11fe9ab4-e996-4add-9ff2-8bae39e4362d tempest-CreateVolumesFromSnapshotTest-1448285247 None] Created reservations ['735affdc-1e83-43f9-a6ed-ca7d69ee3446', '4f37c306-7475-43dd-a730-e0459de6d35f', '6ef65f2f-d759-446d-8cbf-1ed72f003eda', 'c280b567-343c-4277-b1b1-b5273c9f3974'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:26:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-11fe9ab4-e996-4add-9ff2-8bae39e4362d tempest-CreateVolumesFromSnapshotTest-1448285247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-11fe9ab4-e996-4add-9ff2-8bae39e4362d tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:33 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-11fe9ab4-e996-4add-9ff2-8bae39e4362d tempest-CreateVolumesFromSnapshotTest-1448285247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:33 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-11fe9ab4-e996-4add-9ff2-8bae39e4362d tempest-CreateVolumesFromSnapshotTest-1448285247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-11fe9ab4-e996-4add-9ff2-8bae39e4362d tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-11fe9ab4-e996-4add-9ff2-8bae39e4362d tempest-CreateVolumesFromSnapshotTest-1448285247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:33 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:26:33 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:33 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-11fe9ab4-e996-4add-9ff2-8bae39e4362d tempest-CreateVolumesFromSnapshotTest-1448285247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.658s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:33 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-11fe9ab4-e996-4add-9ff2-8bae39e4362d tempest-CreateVolumesFromSnapshotTest-1448285247 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:26:33 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-11fe9ab4-e996-4add-9ff2-8bae39e4362d tempest-CreateVolumesFromSnapshotTest-1448285247 None] Deleted volume successfully. Jul 08 01:26:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-11fe9ab4-e996-4add-9ff2-8bae39e4362d tempest-CreateVolumesFromSnapshotTest-1448285247 None] Lock "cinder-fd29c3e6-a90c-4be6-8435-4b9f48412a12-delete_volume" released by "delete_volume" :: held 2.401s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:36 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:UPDATE=143,cinder:SELECT=83,cinder:DELETE=9,cinder:INSERT=30 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:26:36 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=91,cinder:UPDATE=115,cinder:INSERT=30,cinder:DELETE=14 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:26:36 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:26:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Flow 'volume_create_manager' (964248a8-81c1-426d-ad86-a2853e15dcbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2137f582-fa42-416e-82b4-3a0efb531a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2137f582-fa42-416e-82b4-3a0efb531a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0676af70-a7ce-4c31-9322-b307c1063c18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e75f190b68448cac1e796bfe89a8a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:36Z,use_quota=True,user_id='dbbf5729d8af4b4882e266367ef969d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4e1cc6-706b-47b7-8a0c-38a4e5c6f604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4e1cc6-706b-47b7-8a0c-38a4e5c6f604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5046c195-fe56-447b-834f-bc2c372e0684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5046c195-fe56-447b-834f-bc2c372e0684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0676af70-a7ce-4c31-9322-b307c1063c18', 'volume_name': 'volume-0676af70-a7ce-4c31-9322-b307c1063c18', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bbbb889-731e-442a-b893-808f287d51a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bbbb889-731e-442a-b893-808f287d51a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e688ccad-fa39-4b08-9181-cd2df7feec57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:36 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Volume 0676af70-a7ce-4c31-9322-b307c1063c18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0676af70-a7ce-4c31-9322-b307c1063c18', 'volume_size': 1} Jul 08 01:26:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0676af70-a7ce-4c31-9322-b307c1063c18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e75f190b68448cac1e796bfe89a8a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:36Z,use_quota=True,user_id='dbbf5729d8af4b4882e266367ef969d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:26:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Creating volume 0676af70-a7ce-4c31-9322-b307c1063c18 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:26:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:26:36 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:26:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0676af70-a7ce-4c31-9322-b307c1063c18 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:36 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0676af70-a7ce-4c31-9322-b307c1063c18 1073741824 Jul 08 01:26:36 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:37 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0676af70-a7ce-4c31-9322-b307c1063c18 1073741824" returned: 0 in 0.865s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0676af70-a7ce-4c31-9322-b307c1063c18 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:37 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0676af70-a7ce-4c31-9322-b307c1063c18 Jul 08 01:26:37 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:38 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0676af70-a7ce-4c31-9322-b307c1063c18" returned: 0 in 0.626s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:26:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e688ccad-fa39-4b08-9181-cd2df7feec57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0676af70-a7ce-4c31-9322-b307c1063c18', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a2348e-fa3c-4456-8197-aeaf4d9b9a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:38 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Volume volume-0676af70-a7ce-4c31-9322-b307c1063c18 (0676af70-a7ce-4c31-9322-b307c1063c18): created successfully Jul 08 01:26:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a2348e-fa3c-4456-8197-aeaf4d9b9a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Flow 'volume_create_manager' (964248a8-81c1-426d-ad86-a2853e15dcbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:38 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-1570856a-0184-4390-ac89-c2391e9983f0 tempest-CinderUnicodeTest-964741276 None] Created volume successfully. Jul 08 01:26:39 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:26:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Flow 'volume_create_manager' (08723e49-a59f-4115-b259-957e3c8006ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9282f33-0570-4418-8e41-473dcb395176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9282f33-0570-4418-8e41-473dcb395176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1506726521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a37ba55-9416-4cc7-bf14-931ff7d06667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e75f190b68448cac1e796bfe89a8a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:39Z,use_quota=True,user_id='dbbf5729d8af4b4882e266367ef969d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057f312a-0c77-4bb4-be1f-728942b5ffdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057f312a-0c77-4bb4-be1f-728942b5ffdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1349da9b-ef66-4d20-b04c-d75a9df19826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1349da9b-ef66-4d20-b04c-d75a9df19826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a37ba55-9416-4cc7-bf14-931ff7d06667', 'volume_name': 'volume-9a37ba55-9416-4cc7-bf14-931ff7d06667', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fca76cbf-1abe-4355-9ce4-3903ab9576bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fca76cbf-1abe-4355-9ce4-3903ab9576bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef4c2f42-f6a7-437a-a2f1-065023f5621c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:39 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Volume 9a37ba55-9416-4cc7-bf14-931ff7d06667: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a37ba55-9416-4cc7-bf14-931ff7d06667', 'volume_size': 1} Jul 08 01:26:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:39 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1506726521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a37ba55-9416-4cc7-bf14-931ff7d06667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e75f190b68448cac1e796bfe89a8a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:39Z,use_quota=True,user_id='dbbf5729d8af4b4882e266367ef969d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:26:39 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Creating volume 9a37ba55-9416-4cc7-bf14-931ff7d06667 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:26:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:39 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:39 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:39 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:26:39 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:26:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:39 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667 1073741824 Jul 08 01:26:39 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:40 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667 1073741824" returned: 0 in 0.879s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:40 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667 Jul 08 01:26:40 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:40 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667" returned: 0 in 0.696s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:40 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:26:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef4c2f42-f6a7-437a-a2f1-065023f5621c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a37ba55-9416-4cc7-bf14-931ff7d06667', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f7a42a-cb9f-4d49-a17f-7e6e40306b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:40 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Volume volume-9a37ba55-9416-4cc7-bf14-931ff7d06667 (9a37ba55-9416-4cc7-bf14-931ff7d06667): created successfully Jul 08 01:26:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f7a42a-cb9f-4d49-a17f-7e6e40306b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Flow 'volume_create_manager' (08723e49-a59f-4115-b259-957e3c8006ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:40 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-97fc297a-e92c-4cad-96a2-78dfe75f4afa tempest-CinderUnicodeTest-964741276 None] Created volume successfully. Jul 08 01:26:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4629a785-a8c5-49db-93d0-dd75b026be04 tempest-CinderUnicodeTest-964741276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4629a785-a8c5-49db-93d0-dd75b026be04 tempest-CinderUnicodeTest-964741276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:41 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-4629a785-a8c5-49db-93d0-dd75b026be04 tempest-CinderUnicodeTest-964741276 None] Creating offline snapshot 09f11593-2db7-4d8e-922c-bb70fdae0cbd of volume 9a37ba55-9416-4cc7-bf14-931ff7d06667 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:26:41 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e96c59-bacd-41d5-959b-ce1cdaebf685]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4629a785-a8c5-49db-93d0-dd75b026be04 tempest-CinderUnicodeTest-964741276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:41 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667 Jul 08 01:26:41 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:42 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4629a785-a8c5-49db-93d0-dd75b026be04 tempest-CinderUnicodeTest-964741276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667" returned: 0 in 0.766s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4629a785-a8c5-49db-93d0-dd75b026be04 tempest-CinderUnicodeTest-964741276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667.09f11593-2db7-4d8e-922c-bb70fdae0cbd 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:42 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667.09f11593-2db7-4d8e-922c-bb70fdae0cbd 1G Jul 08 01:26:42 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:43 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4629a785-a8c5-49db-93d0-dd75b026be04 tempest-CinderUnicodeTest-964741276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667.09f11593-2db7-4d8e-922c-bb70fdae0cbd 1G" returned: 0 in 0.825s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4629a785-a8c5-49db-93d0-dd75b026be04 tempest-CinderUnicodeTest-964741276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a37ba55-9416-4cc7-bf14-931ff7d06667 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667.09f11593-2db7-4d8e-922c-bb70fdae0cbd {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:43 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a37ba55-9416-4cc7-bf14-931ff7d06667 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667.09f11593-2db7-4d8e-922c-bb70fdae0cbd Jul 08 01:26:43 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:43 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4629a785-a8c5-49db-93d0-dd75b026be04 tempest-CinderUnicodeTest-964741276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a37ba55-9416-4cc7-bf14-931ff7d06667 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667.09f11593-2db7-4d8e-922c-bb70fdae0cbd" returned: 0 in 0.729s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:43 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-4629a785-a8c5-49db-93d0-dd75b026be04 tempest-CinderUnicodeTest-964741276 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667.09f11593-2db7-4d8e-922c-bb70fdae0cbd is being set with open permissions: ugo+rw Jul 08 01:26:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4629a785-a8c5-49db-93d0-dd75b026be04 tempest-CinderUnicodeTest-964741276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667.09f11593-2db7-4d8e-922c-bb70fdae0cbd {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:43 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667.09f11593-2db7-4d8e-922c-bb70fdae0cbd Jul 08 01:26:43 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:44 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4629a785-a8c5-49db-93d0-dd75b026be04 tempest-CinderUnicodeTest-964741276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667.09f11593-2db7-4d8e-922c-bb70fdae0cbd" returned: 0 in 0.615s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4629a785-a8c5-49db-93d0-dd75b026be04 tempest-CinderUnicodeTest-964741276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:44 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667.info Jul 08 01:26:44 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:45 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4629a785-a8c5-49db-93d0-dd75b026be04 tempest-CinderUnicodeTest-964741276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667.info" returned: 0 in 0.641s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:45 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-4629a785-a8c5-49db-93d0-dd75b026be04 tempest-CinderUnicodeTest-964741276 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667.info is being set with open permissions: ugo+rw Jul 08 01:26:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4629a785-a8c5-49db-93d0-dd75b026be04 tempest-CinderUnicodeTest-964741276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:45 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667.info Jul 08 01:26:45 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:45 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:26:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:45 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:26:45 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:45 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4629a785-a8c5-49db-93d0-dd75b026be04 tempest-CinderUnicodeTest-964741276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667.info" returned: 0 in 0.645s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4629a785-a8c5-49db-93d0-dd75b026be04 tempest-CinderUnicodeTest-964741276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.313s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:45 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-4629a785-a8c5-49db-93d0-dd75b026be04 tempest-CinderUnicodeTest-964741276 None] Create snapshot completed successfully Jul 08 01:26:46 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.697s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:46 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:26:46 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:26:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread count: 28 {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:26:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread info: [<_MainThread(MainThread, started 134382216167552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:26:46 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2acce3a2-d6d9-4209-a281-894d32aff0cd tempest-CinderUnicodeTest-964741276 None] Acquiring lock "cinder-09f11593-2db7-4d8e-922c-bb70fdae0cbd-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:46 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2acce3a2-d6d9-4209-a281-894d32aff0cd tempest-CinderUnicodeTest-964741276 None] Lock "cinder-09f11593-2db7-4d8e-922c-bb70fdae0cbd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:46 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2acce3a2-d6d9-4209-a281-894d32aff0cd tempest-CinderUnicodeTest-964741276 None] Acquiring lock "cinder-quobyte-9a37ba55-9416-4cc7-bf14-931ff7d06667" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:46 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2acce3a2-d6d9-4209-a281-894d32aff0cd tempest-CinderUnicodeTest-964741276 None] Lock "cinder-quobyte-9a37ba55-9416-4cc7-bf14-931ff7d06667" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:46 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2acce3a2-d6d9-4209-a281-894d32aff0cd tempest-CinderUnicodeTest-964741276 None] Acquiring lock "cinder-quobyte-09f11593-2db7-4d8e-922c-bb70fdae0cbd" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:46 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2acce3a2-d6d9-4209-a281-894d32aff0cd tempest-CinderUnicodeTest-964741276 None] Lock "cinder-quobyte-09f11593-2db7-4d8e-922c-bb70fdae0cbd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:46 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-2acce3a2-d6d9-4209-a281-894d32aff0cd tempest-CinderUnicodeTest-964741276 None] Deleting offline snapshot 09f11593-2db7-4d8e-922c-bb70fdae0cbd of volume 9a37ba55-9416-4cc7-bf14-931ff7d06667 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:26:46 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-2acce3a2-d6d9-4209-a281-894d32aff0cd tempest-CinderUnicodeTest-964741276 None] snapshot_file for this snap is: volume-9a37ba55-9416-4cc7-bf14-931ff7d06667.09f11593-2db7-4d8e-922c-bb70fdae0cbd {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:26:46 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04a17a3-94d1-46f0-8309-4c016800a815]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2acce3a2-d6d9-4209-a281-894d32aff0cd tempest-CinderUnicodeTest-964741276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667.09f11593-2db7-4d8e-922c-bb70fdae0cbd {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:46 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667.09f11593-2db7-4d8e-922c-bb70fdae0cbd Jul 08 01:26:46 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:47 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2acce3a2-d6d9-4209-a281-894d32aff0cd tempest-CinderUnicodeTest-964741276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667.09f11593-2db7-4d8e-922c-bb70fdae0cbd" returned: 0 in 0.764s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:47 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-2acce3a2-d6d9-4209-a281-894d32aff0cd tempest-CinderUnicodeTest-964741276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a37ba55-9416-4cc7-bf14-931ff7d06667(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:26:47 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fca581-f883-4b83-bd34-7427f11cf5a9]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2acce3a2-d6d9-4209-a281-894d32aff0cd tempest-CinderUnicodeTest-964741276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:47 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667 Jul 08 01:26:47 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:48 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2acce3a2-d6d9-4209-a281-894d32aff0cd tempest-CinderUnicodeTest-964741276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667" returned: 0 in 0.793s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2acce3a2-d6d9-4209-a281-894d32aff0cd tempest-CinderUnicodeTest-964741276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667.09f11593-2db7-4d8e-922c-bb70fdae0cbd {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:48 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667.09f11593-2db7-4d8e-922c-bb70fdae0cbd Jul 08 01:26:48 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:49 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2acce3a2-d6d9-4209-a281-894d32aff0cd tempest-CinderUnicodeTest-964741276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667.09f11593-2db7-4d8e-922c-bb70fdae0cbd" returned: 0 in 0.740s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2acce3a2-d6d9-4209-a281-894d32aff0cd tempest-CinderUnicodeTest-964741276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667.09f11593-2db7-4d8e-922c-bb70fdae0cbd {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:49 devstack sudo[104527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667.09f11593-2db7-4d8e-922c-bb70fdae0cbd Jul 08 01:26:49 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:49 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2acce3a2-d6d9-4209-a281-894d32aff0cd tempest-CinderUnicodeTest-964741276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667.09f11593-2db7-4d8e-922c-bb70fdae0cbd" returned: 0 in 0.639s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:49 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2acce3a2-d6d9-4209-a281-894d32aff0cd tempest-CinderUnicodeTest-964741276 None] Lock "cinder-quobyte-09f11593-2db7-4d8e-922c-bb70fdae0cbd" released by "_delete_snapshot" :: held 3.039s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:49 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2acce3a2-d6d9-4209-a281-894d32aff0cd tempest-CinderUnicodeTest-964741276 None] Lock "cinder-quobyte-9a37ba55-9416-4cc7-bf14-931ff7d06667" released by "delete_snapshot" :: held 3.065s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:49 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-2acce3a2-d6d9-4209-a281-894d32aff0cd tempest-CinderUnicodeTest-964741276 None] Created reservations ['a6b6085c-fa8f-4066-87d8-56ab8ee0b597', 'e629a7d4-7b3c-4dca-acb0-28913927fc93', '3326ff2b-4626-4a39-8082-73ef7c2f4102', '84546edb-86b4-435d-8aae-63edc165a3ff'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:26:49 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-2acce3a2-d6d9-4209-a281-894d32aff0cd tempest-CinderUnicodeTest-964741276 None] Delete snapshot completed successfully. Jul 08 01:26:49 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2acce3a2-d6d9-4209-a281-894d32aff0cd tempest-CinderUnicodeTest-964741276 None] Lock "cinder-09f11593-2db7-4d8e-922c-bb70fdae0cbd-delete_snapshot" released by "delete_snapshot" :: held 3.198s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b3c42ac4-3c12-4503-a493-48a309f95479 tempest-CinderUnicodeTest-964741276 None] Acquiring lock "cinder-9a37ba55-9416-4cc7-bf14-931ff7d06667-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b3c42ac4-3c12-4503-a493-48a309f95479 tempest-CinderUnicodeTest-964741276 None] Lock "cinder-9a37ba55-9416-4cc7-bf14-931ff7d06667-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b3c42ac4-3c12-4503-a493-48a309f95479 tempest-CinderUnicodeTest-964741276 None] Acquiring lock "cinder-quobyte-9a37ba55-9416-4cc7-bf14-931ff7d06667" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b3c42ac4-3c12-4503-a493-48a309f95479 tempest-CinderUnicodeTest-964741276 None] Lock "cinder-quobyte-9a37ba55-9416-4cc7-bf14-931ff7d06667" acquired by "delete_volume" :: waited 0.015s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:51 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adb385f-0036-4195-8760-dc3f6addd5b7]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b3c42ac4-3c12-4503-a493-48a309f95479 tempest-CinderUnicodeTest-964741276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:51 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667 Jul 08 01:26:51 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:51 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b3c42ac4-3c12-4503-a493-48a309f95479 tempest-CinderUnicodeTest-964741276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667" returned: 0 in 0.780s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b3c42ac4-3c12-4503-a493-48a309f95479 tempest-CinderUnicodeTest-964741276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:51 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667 Jul 08 01:26:51 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:52 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b3c42ac4-3c12-4503-a493-48a309f95479 tempest-CinderUnicodeTest-964741276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-9a37ba55-9416-4cc7-bf14-931ff7d06667" returned: 0 in 0.665s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:52 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b3c42ac4-3c12-4503-a493-48a309f95479 tempest-CinderUnicodeTest-964741276 None] Lock "cinder-quobyte-9a37ba55-9416-4cc7-bf14-931ff7d06667" released by "delete_volume" :: held 1.509s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:52 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-b3c42ac4-3c12-4503-a493-48a309f95479 tempest-CinderUnicodeTest-964741276 None] Created reservations ['570ddf23-733e-4ae0-8f0b-0289095a39f8', '193d731a-19a5-4e26-b3a7-ef7797db9fff', 'f6107773-bccc-4666-887f-47429f68c816', '51348bf3-9825-4c84-9e4d-758e49bc5745'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:26:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b3c42ac4-3c12-4503-a493-48a309f95479 tempest-CinderUnicodeTest-964741276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b3c42ac4-3c12-4503-a493-48a309f95479 tempest-CinderUnicodeTest-964741276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b3c42ac4-3c12-4503-a493-48a309f95479 tempest-CinderUnicodeTest-964741276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b3c42ac4-3c12-4503-a493-48a309f95479 tempest-CinderUnicodeTest-964741276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b3c42ac4-3c12-4503-a493-48a309f95479 tempest-CinderUnicodeTest-964741276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b3c42ac4-3c12-4503-a493-48a309f95479 tempest-CinderUnicodeTest-964741276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:52 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:26:52 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:53 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-41d2db47-c9c4-4ede-9dd7-9c78fc8d7bd5 tempest-CinderUnicodeTest-964741276 None] Acquiring lock "cinder-0676af70-a7ce-4c31-9322-b307c1063c18-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:53 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-41d2db47-c9c4-4ede-9dd7-9c78fc8d7bd5 tempest-CinderUnicodeTest-964741276 None] Lock "cinder-0676af70-a7ce-4c31-9322-b307c1063c18-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:53 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-41d2db47-c9c4-4ede-9dd7-9c78fc8d7bd5 tempest-CinderUnicodeTest-964741276 None] Acquiring lock "cinder-quobyte-0676af70-a7ce-4c31-9322-b307c1063c18" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:53 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-41d2db47-c9c4-4ede-9dd7-9c78fc8d7bd5 tempest-CinderUnicodeTest-964741276 None] Lock "cinder-quobyte-0676af70-a7ce-4c31-9322-b307c1063c18" acquired by "delete_volume" :: waited 0.016s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:53 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[09501343-23ce-4568-b54c-ecf69e0a5ec5]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-41d2db47-c9c4-4ede-9dd7-9c78fc8d7bd5 tempest-CinderUnicodeTest-964741276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0676af70-a7ce-4c31-9322-b307c1063c18 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:53 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b3c42ac4-3c12-4503-a493-48a309f95479 tempest-CinderUnicodeTest-964741276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.672s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:53 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-b3c42ac4-3c12-4503-a493-48a309f95479 tempest-CinderUnicodeTest-964741276 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:26:53 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-b3c42ac4-3c12-4503-a493-48a309f95479 tempest-CinderUnicodeTest-964741276 None] Deleted volume successfully. Jul 08 01:26:53 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b3c42ac4-3c12-4503-a493-48a309f95479 tempest-CinderUnicodeTest-964741276 None] Lock "cinder-9a37ba55-9416-4cc7-bf14-931ff7d06667-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:53 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0676af70-a7ce-4c31-9322-b307c1063c18 Jul 08 01:26:53 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:54 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-41d2db47-c9c4-4ede-9dd7-9c78fc8d7bd5 tempest-CinderUnicodeTest-964741276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0676af70-a7ce-4c31-9322-b307c1063c18" returned: 0 in 0.797s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-41d2db47-c9c4-4ede-9dd7-9c78fc8d7bd5 tempest-CinderUnicodeTest-964741276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0676af70-a7ce-4c31-9322-b307c1063c18 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:54 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0676af70-a7ce-4c31-9322-b307c1063c18 Jul 08 01:26:54 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:54 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-41d2db47-c9c4-4ede-9dd7-9c78fc8d7bd5 tempest-CinderUnicodeTest-964741276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0676af70-a7ce-4c31-9322-b307c1063c18" returned: 0 in 0.670s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:54 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-41d2db47-c9c4-4ede-9dd7-9c78fc8d7bd5 tempest-CinderUnicodeTest-964741276 None] Lock "cinder-quobyte-0676af70-a7ce-4c31-9322-b307c1063c18" released by "delete_volume" :: held 1.516s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:54 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-41d2db47-c9c4-4ede-9dd7-9c78fc8d7bd5 tempest-CinderUnicodeTest-964741276 None] Created reservations ['55aeeef4-6e55-4333-8e47-c90f445af98c', '908b5c38-76ec-4b6e-9b46-c9ad6af2ddb3', '317b949b-3737-4f69-9fc9-7d47c7229ee2', 'aa7768b2-6488-4190-b233-b21abd98abb3'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:26:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-41d2db47-c9c4-4ede-9dd7-9c78fc8d7bd5 tempest-CinderUnicodeTest-964741276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-41d2db47-c9c4-4ede-9dd7-9c78fc8d7bd5 tempest-CinderUnicodeTest-964741276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:54 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-41d2db47-c9c4-4ede-9dd7-9c78fc8d7bd5 tempest-CinderUnicodeTest-964741276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:54 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-41d2db47-c9c4-4ede-9dd7-9c78fc8d7bd5 tempest-CinderUnicodeTest-964741276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-41d2db47-c9c4-4ede-9dd7-9c78fc8d7bd5 tempest-CinderUnicodeTest-964741276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-41d2db47-c9c4-4ede-9dd7-9c78fc8d7bd5 tempest-CinderUnicodeTest-964741276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:54 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:26:54 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:55 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-41d2db47-c9c4-4ede-9dd7-9c78fc8d7bd5 tempest-CinderUnicodeTest-964741276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.688s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:55 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-41d2db47-c9c4-4ede-9dd7-9c78fc8d7bd5 tempest-CinderUnicodeTest-964741276 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:26:55 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-41d2db47-c9c4-4ede-9dd7-9c78fc8d7bd5 tempest-CinderUnicodeTest-964741276 None] Deleted volume successfully. Jul 08 01:26:55 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-41d2db47-c9c4-4ede-9dd7-9c78fc8d7bd5 tempest-CinderUnicodeTest-964741276 None] Lock "cinder-0676af70-a7ce-4c31-9322-b307c1063c18-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:04 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=26,cinder:INSERT=9,cinder:UPDATE=25,cinder:DELETE=2 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:27:05 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:UPDATE=32,cinder:SELECT=19,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Flow 'volume_create_manager' (6b8315df-314b-4edc-a0d5-f2545b5a6be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f5fb98b-a57d-4910-9d3c-e7864a47efb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f5fb98b-a57d-4910-9d3c-e7864a47efb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1887668479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aec08254-83de-4049-8a62-4dba35bcaabd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d4b3b364bc4a109a8839709009be1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:12Z,use_quota=True,user_id='458e0a86b626433bb89eefdd91bdc079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c43d1647-8c16-4532-af64-960063ccc5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c43d1647-8c16-4532-af64-960063ccc5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b39e4bd5-9d73-4e34-8ce6-43579df89e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b39e4bd5-9d73-4e34-8ce6-43579df89e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aec08254-83de-4049-8a62-4dba35bcaabd', 'volume_name': 'volume-aec08254-83de-4049-8a62-4dba35bcaabd', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a23c43fa-ee7a-4748-9f13-f2fcba82e21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a23c43fa-ee7a-4748-9f13-f2fcba82e21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8bdc3ce-ccb0-4a4d-9990-4916cd1777f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:12 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Volume aec08254-83de-4049-8a62-4dba35bcaabd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aec08254-83de-4049-8a62-4dba35bcaabd', 'volume_size': 1} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1887668479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aec08254-83de-4049-8a62-4dba35bcaabd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d4b3b364bc4a109a8839709009be1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:12Z,use_quota=True,user_id='458e0a86b626433bb89eefdd91bdc079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Creating volume aec08254-83de-4049-8a62-4dba35bcaabd {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:27:12 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:12 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd 1073741824 Jul 08 01:27:12 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Flow 'volume_create_manager' (feb9d627-fe8e-4816-89c5-bfda50affe11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb5c503-51bc-46c4-a1a6-f02b804b503d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb5c503-51bc-46c4-a1a6-f02b804b503d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e71f11f4-31d3-4328-a366-b586cc54ca3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863b23cdc3d543c4a92039107758fc14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:13Z,use_quota=True,user_id='8c89f88250a841129760707665e78c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb71fb0-5278-4ec4-820d-56134f01b4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb71fb0-5278-4ec4-820d-56134f01b4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f18189e-63db-42a6-a1a1-4d38c5bdf48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f18189e-63db-42a6-a1a1-4d38c5bdf48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e71f11f4-31d3-4328-a366-b586cc54ca3c', 'volume_name': 'volume-e71f11f4-31d3-4328-a366-b586cc54ca3c', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9096101f-7465-4caf-b36e-cd9897a71ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9096101f-7465-4caf-b36e-cd9897a71ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38776103-1f57-4b55-a378-a566369052d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:12 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Volume e71f11f4-31d3-4328-a366-b586cc54ca3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e71f11f4-31d3-4328-a366-b586cc54ca3c', 'volume_size': 1} Jul 08 01:27:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:13 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:27:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Flow 'volume_create_manager' (523cdc9f-9a3f-4a6c-b054-bf634041ad07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ff5e42-da20-486f-b1c3-4c2f5d1067e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ff5e42-da20-486f-b1c3-4c2f5d1067e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1259836138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6549cb56-f990-406b-b8c2-2768a4fde927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4261bf8c2f7c43c2ae1ea916cdaf4831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:13Z,use_quota=True,user_id='ada7289d1e83486089398851d001832d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c4f5ff-1a74-428a-b7be-0cedea21cc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c4f5ff-1a74-428a-b7be-0cedea21cc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5293d88-2969-4aea-af9e-8593466d6ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5293d88-2969-4aea-af9e-8593466d6ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6549cb56-f990-406b-b8c2-2768a4fde927', 'volume_name': 'volume-6549cb56-f990-406b-b8c2-2768a4fde927', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ea5d18-a75f-4550-a13b-4fee4386dd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ea5d18-a75f-4550-a13b-4fee4386dd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df52d9b2-5bbd-4668-ab9b-8c3b8c7ba86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:13 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Volume 6549cb56-f990-406b-b8c2-2768a4fde927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6549cb56-f990-406b-b8c2-2768a4fde927', 'volume_size': 1} Jul 08 01:27:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:13 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:27:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Flow 'volume_create_manager' (dd413caf-05cc-4175-8cee-b77408df16e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118731d2-cbfa-4264-9884-4e89fae82387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118731d2-cbfa-4264-9884-4e89fae82387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-11955333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576e3812-0946-4e76-b6c2-8f0aacbfa7c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4261bf8c2f7c43c2ae1ea916cdaf4831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:13Z,use_quota=True,user_id='ada7289d1e83486089398851d001832d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddafdefd-89a5-4150-adb8-f5ac7f5152b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddafdefd-89a5-4150-adb8-f5ac7f5152b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f477b71-cc57-485d-84e8-78c6efac0937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f477b71-cc57-485d-84e8-78c6efac0937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '576e3812-0946-4e76-b6c2-8f0aacbfa7c6', 'volume_name': 'volume-576e3812-0946-4e76-b6c2-8f0aacbfa7c6', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc8cef5-6337-4787-8f40-0595ab9af0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc8cef5-6337-4787-8f40-0595ab9af0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af0001ac-3f80-4123-a293-9858948be0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:13 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Volume 576e3812-0946-4e76-b6c2-8f0aacbfa7c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-576e3812-0946-4e76-b6c2-8f0aacbfa7c6', 'volume_size': 1} Jul 08 01:27:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:13 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd 1073741824" returned: 0 in 1.229s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:13 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd Jul 08 01:27:13 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:13 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:27:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Flow 'volume_create_manager' (1e6524a2-f1f5-4849-8ab3-e07fa6d76974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8981473-6592-4ba6-b2b4-5ddd1be8340d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8981473-6592-4ba6-b2b4-5ddd1be8340d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1259202611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd0cca02-329c-4faa-a527-4f8b2a8a6272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4261bf8c2f7c43c2ae1ea916cdaf4831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:14Z,use_quota=True,user_id='ada7289d1e83486089398851d001832d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0668a437-4d69-4f70-ad26-a662407c7de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0668a437-4d69-4f70-ad26-a662407c7de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53bb3e08-cf5b-4da1-9e02-3a9f7a2800ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53bb3e08-cf5b-4da1-9e02-3a9f7a2800ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd0cca02-329c-4faa-a527-4f8b2a8a6272', 'volume_name': 'volume-cd0cca02-329c-4faa-a527-4f8b2a8a6272', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (397d8827-92f3-4d93-87e9-5fe9c826347d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (397d8827-92f3-4d93-87e9-5fe9c826347d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17e15da-7256-421d-8506-3b96c801ee9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:14 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Volume cd0cca02-329c-4faa-a527-4f8b2a8a6272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd0cca02-329c-4faa-a527-4f8b2a8a6272', 'volume_size': 1} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Flow 'volume_create_manager' (7d25f45a-975e-4895-83c0-7c8e2546fad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cab4dea1-c614-4073-9b39-7e053e6c45bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cab4dea1-c614-4073-9b39-7e053e6c45bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1431190543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce53e7b5-d664-46f9-8ffa-993d3b0b8e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4261bf8c2f7c43c2ae1ea916cdaf4831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:14Z,use_quota=True,user_id='ada7289d1e83486089398851d001832d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029cab83-2845-448a-baf7-ddaa9f7ae1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029cab83-2845-448a-baf7-ddaa9f7ae1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0e0aa5-131c-4ed1-86e7-74963596d3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0e0aa5-131c-4ed1-86e7-74963596d3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce53e7b5-d664-46f9-8ffa-993d3b0b8e2b', 'volume_name': 'volume-ce53e7b5-d664-46f9-8ffa-993d3b0b8e2b', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292b6318-5f5c-4c9e-a533-6a68c6d50832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292b6318-5f5c-4c9e-a533-6a68c6d50832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (139d46f6-f88b-44b3-89b9-aa621eb62b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:14 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Volume ce53e7b5-d664-46f9-8ffa-993d3b0b8e2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce53e7b5-d664-46f9-8ffa-993d3b0b8e2b', 'volume_size': 1} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:14 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd" returned: 0 in 0.870s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] <== create_volume: return (2161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.164s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.927s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e71f11f4-31d3-4328-a366-b586cc54ca3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863b23cdc3d543c4a92039107758fc14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:13Z,use_quota=True,user_id='8c89f88250a841129760707665e78c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Creating volume e71f11f4-31d3-4328-a366-b586cc54ca3c {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:27:14 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e71f11f4-31d3-4328-a366-b586cc54ca3c 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8bdc3ce-ccb0-4a4d-9990-4916cd1777f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aec08254-83de-4049-8a62-4dba35bcaabd', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:14 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e71f11f4-31d3-4328-a366-b586cc54ca3c 1073741824 Jul 08 01:27:14 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a64aa7bc-6ce7-4c83-afcf-6a843b5b19a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:14 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Volume volume-aec08254-83de-4049-8a62-4dba35bcaabd (aec08254-83de-4049-8a62-4dba35bcaabd): created successfully Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a64aa7bc-6ce7-4c83-afcf-6a843b5b19a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Flow 'volume_create_manager' (6b8315df-314b-4edc-a0d5-f2545b5a6be7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:14 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-ebb0c314-8cad-4450-92f4-e25bf215600b tempest-CreateVolumesFromSnapshotTest-414282402 None] Created volume successfully. Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Flow 'volume_create_manager' (9bed1bed-5983-4ccd-9e75-f527c27e5e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2273ba77-6fd7-48bb-9d8a-675b5d44bbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2273ba77-6fd7-48bb-9d8a-675b5d44bbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-757603392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=196d0e6a-f911-441b-8f55-6beda1aea701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4261bf8c2f7c43c2ae1ea916cdaf4831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:15Z,use_quota=True,user_id='ada7289d1e83486089398851d001832d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b79de8a-3a5a-4e2d-83b5-9af43640f95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b79de8a-3a5a-4e2d-83b5-9af43640f95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dff3870-b577-4252-ab4e-405940cd193e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dff3870-b577-4252-ab4e-405940cd193e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '196d0e6a-f911-441b-8f55-6beda1aea701', 'volume_name': 'volume-196d0e6a-f911-441b-8f55-6beda1aea701', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab50ce2-4aea-4da9-8696-87b6a434b71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab50ce2-4aea-4da9-8696-87b6a434b71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31552ee5-98fc-4311-b260-aaf756435672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:14 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Volume 196d0e6a-f911-441b-8f55-6beda1aea701: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-196d0e6a-f911-441b-8f55-6beda1aea701', 'volume_size': 1} Jul 08 01:27:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:15 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e71f11f4-31d3-4328-a366-b586cc54ca3c 1073741824" returned: 0 in 0.995s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e71f11f4-31d3-4328-a366-b586cc54ca3c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:15 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e71f11f4-31d3-4328-a366-b586cc54ca3c Jul 08 01:27:15 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-094e2f8b-8752-41b1-9398-9798c79d5b71 tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:16 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e71f11f4-31d3-4328-a366-b586cc54ca3c" returned: 0 in 0.747s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:27:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.303s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1259836138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6549cb56-f990-406b-b8c2-2768a4fde927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4261bf8c2f7c43c2ae1ea916cdaf4831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:13Z,use_quota=True,user_id='ada7289d1e83486089398851d001832d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:27:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Creating volume 6549cb56-f990-406b-b8c2-2768a4fde927 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:27:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:27:16 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:27:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6549cb56-f990-406b-b8c2-2768a4fde927 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38776103-1f57-4b55-a378-a566369052d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e71f11f4-31d3-4328-a366-b586cc54ca3c', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:16 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6549cb56-f990-406b-b8c2-2768a4fde927 1073741824 Jul 08 01:27:16 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672a6977-72b6-4bc9-89a3-4b79dd58e515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:16 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Volume volume-e71f11f4-31d3-4328-a366-b586cc54ca3c (e71f11f4-31d3-4328-a366-b586cc54ca3c): created successfully Jul 08 01:27:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672a6977-72b6-4bc9-89a3-4b79dd58e515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Flow 'volume_create_manager' (feb9d627-fe8e-4816-89c5-bfda50affe11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:16 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-efa74e93-37c8-48a7-96c2-5f571cc69f6f tempest-CinderUnicodeTest-1134404644 None] Created volume successfully. Jul 08 01:27:16 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:27:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Flow 'volume_create_manager' (66194a49-6320-4a6f-9773-33dc2aeb6924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (888630fc-0541-4552-9b0c-0cd1d303c827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (888630fc-0541-4552-9b0c-0cd1d303c827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7502386e-07eb-4429-a636-0621c193cf21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c3b7ef3b314787999182f342b68712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:17Z,use_quota=True,user_id='5d44b58eae4a412db86e70ac5d890dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc1c387f-2c19-4e1e-9213-92df21c93db6),volume_type_id=cc1c387f-2c19-4e1e-9213-92df21c93db6)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c07e719-4f16-4914-ad41-22166d5a9392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c07e719-4f16-4914-ad41-22166d5a9392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3441ed86-94c4-4ca2-abe2-edd954cf6f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:16 devstack cinder-volume[87022]: DEBUG cinder.image.glance [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Creating Keystone auth plugin from conf {{(pid=87022) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:27:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3441ed86-94c4-4ca2-abe2-edd954cf6f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7502386e-07eb-4429-a636-0621c193cf21', 'volume_name': 'volume-7502386e-07eb-4429-a636-0621c193cf21', 'volume_size': 1, 'image_id': 'b7c90f89-0971-4104-acb7-ed28edd8a384', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7c90f89-0971-4104-acb7-ed28edd8a384', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f274727823036322616b2fc0465662d7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '63c3b7ef3b314787999182f342b68712', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '60377d026747c255c2bb34717d4a791a732602bd8e9b658bf8a7deffc0725493021584d0adc037dc652d4d125d5bb4c9ea952aa588d8e3949b245e70be9696ad', 'id': 'b7c90f89-0971-4104-acb7-ed28edd8a384', 'created_at': datetime.datetime(2026, 7, 7, 23, 27, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 27, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7c90f89-0971-4104-acb7-ed28edd8a384/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7166f19a-10eb-4513-b538-da5affbb3aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7166f19a-10eb-4513-b538-da5affbb3aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29c277d-bcad-4a24-ab44-62301d38acc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:17 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Volume 7502386e-07eb-4429-a636-0621c193cf21: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7502386e-07eb-4429-a636-0621c193cf21', 'volume_size': 1, 'image_id': 'b7c90f89-0971-4104-acb7-ed28edd8a384', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7c90f89-0971-4104-acb7-ed28edd8a384', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f274727823036322616b2fc0465662d7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '63c3b7ef3b314787999182f342b68712', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '60377d026747c255c2bb34717d4a791a732602bd8e9b658bf8a7deffc0725493021584d0adc037dc652d4d125d5bb4c9ea952aa588d8e3949b245e70be9696ad', 'id': 'b7c90f89-0971-4104-acb7-ed28edd8a384', 'created_at': datetime.datetime(2026, 7, 7, 23, 27, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 27, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7c90f89-0971-4104-acb7-ed28edd8a384/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 01:27:17 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Trying to clone 7502386e-07eb-4429-a636-0621c193cf21 from image b7c90f89-0971-4104-acb7-ed28edd8a384 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b7c90f89-0971-4104-acb7-ed28edd8a384', 'metadata': {}}]). {{(pid=87022) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:27:17 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b7c90f89-0971-4104-acb7-ed28edd8a384_mk_b66ordevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87022) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:27:17 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Image download 0.00 MB at 0.00 MB/s Jul 08 01:27:17 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f32ab8-38db-4e2f-af56-05b8ae6932bd]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c90f89-0971-4104-acb7-ed28edd8a384_mk_b66ordevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:17 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6549cb56-f990-406b-b8c2-2768a4fde927 1073741824" returned: 0 in 1.000s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:17 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:27:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Flow 'volume_create_manager' (1fc24d72-4a2b-4699-a506-8ff1a31e502f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea77c05b-3c10-440f-bbe8-1a11cb6b5e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea77c05b-3c10-440f-bbe8-1a11cb6b5e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-645165636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f899eee5-8e53-40cd-a37d-cadf20aa30e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863b23cdc3d543c4a92039107758fc14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:17Z,use_quota=True,user_id='8c89f88250a841129760707665e78c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb005f06-2482-4af4-bf7e-268331ce7064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:17 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c90f89-0971-4104-acb7-ed28edd8a384_mk_b66ordevstack@QuobyteHD Jul 08 01:27:17 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb005f06-2482-4af4-bf7e-268331ce7064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06fd0749-8cf6-4acf-a6ea-aab8b76d5e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06fd0749-8cf6-4acf-a6ea-aab8b76d5e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f899eee5-8e53-40cd-a37d-cadf20aa30e8', 'volume_name': 'volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff138c6-f2a6-4f0d-a661-1296f5295a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff138c6-f2a6-4f0d-a661-1296f5295a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b08cdf5-0435-4650-8ddc-b94f68ba2926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:17 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Volume f899eee5-8e53-40cd-a37d-cadf20aa30e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8', 'volume_size': 1} Jul 08 01:27:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6549cb56-f990-406b-b8c2-2768a4fde927 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:17 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6549cb56-f990-406b-b8c2-2768a4fde927 Jul 08 01:27:17 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:18 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c90f89-0971-4104-acb7-ed28edd8a384_mk_b66ordevstack@QuobyteHD" returned: 0 in 0.797s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c90f89-0971-4104-acb7-ed28edd8a384_mk_b66ordevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:18 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6549cb56-f990-406b-b8c2-2768a4fde927" returned: 0 in 0.672s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:27:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.662s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-11955333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576e3812-0946-4e76-b6c2-8f0aacbfa7c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4261bf8c2f7c43c2ae1ea916cdaf4831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:13Z,use_quota=True,user_id='ada7289d1e83486089398851d001832d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:27:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Creating volume 576e3812-0946-4e76-b6c2-8f0aacbfa7c6 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:27:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:27:18 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:27:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-576e3812-0946-4e76-b6c2-8f0aacbfa7c6 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df52d9b2-5bbd-4668-ab9b-8c3b8c7ba86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6549cb56-f990-406b-b8c2-2768a4fde927', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df5e4b9e-fb9d-4aa9-86d8-0f274d42db99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:18 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-576e3812-0946-4e76-b6c2-8f0aacbfa7c6 1073741824 Jul 08 01:27:18 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:18 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Volume volume-6549cb56-f990-406b-b8c2-2768a4fde927 (6549cb56-f990-406b-b8c2-2768a4fde927): created successfully Jul 08 01:27:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df5e4b9e-fb9d-4aa9-86d8-0f274d42db99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Flow 'volume_create_manager' (523cdc9f-9a3f-4a6c-b054-bf634041ad07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:18 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c90f89-0971-4104-acb7-ed28edd8a384_mk_b66ordevstack@QuobyteHD Jul 08 01:27:18 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:18 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-5377e8a0-d3cf-4edc-8774-ddc09aa49908 tempest-CreateVolumesFromImageTest-1504584959 None] Created volume successfully. Jul 08 01:27:19 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c90f89-0971-4104-acb7-ed28edd8a384_mk_b66ordevstack@QuobyteHD" returned: 1 in 0.829s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c90f89-0971-4104-acb7-ed28edd8a384_mk_b66ordevstack@QuobyteHD' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:27:19 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Temporary image b7c90f89-0971-4104-acb7-ed28edd8a384 is fetched for user 5d44b58eae4a412db86e70ac5d890dfd. {{(pid=87022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:27:19 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[160d48ad-a5be-4646-aff7-22dd007cac7c]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c90f89-0971-4104-acb7-ed28edd8a384_mk_b66ordevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:19 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-576e3812-0946-4e76-b6c2-8f0aacbfa7c6 1073741824" returned: 0 in 0.931s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:19 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c90f89-0971-4104-acb7-ed28edd8a384_mk_b66ordevstack@QuobyteHD Jul 08 01:27:19 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-576e3812-0946-4e76-b6c2-8f0aacbfa7c6 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:19 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-576e3812-0946-4e76-b6c2-8f0aacbfa7c6 Jul 08 01:27:19 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:19 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-576e3812-0946-4e76-b6c2-8f0aacbfa7c6" returned: 0 in 0.653s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:27:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.792s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1259202611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd0cca02-329c-4faa-a527-4f8b2a8a6272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4261bf8c2f7c43c2ae1ea916cdaf4831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:14Z,use_quota=True,user_id='ada7289d1e83486089398851d001832d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:27:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Creating volume cd0cca02-329c-4faa-a527-4f8b2a8a6272 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:27:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:27:19 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:27:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cd0cca02-329c-4faa-a527-4f8b2a8a6272 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:19 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c90f89-0971-4104-acb7-ed28edd8a384_mk_b66ordevstack@QuobyteHD" returned: 0 in 0.801s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c90f89-0971-4104-acb7-ed28edd8a384_mk_b66ordevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:19 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cd0cca02-329c-4faa-a527-4f8b2a8a6272 1073741824 Jul 08 01:27:19 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af0001ac-3f80-4123-a293-9858948be0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-576e3812-0946-4e76-b6c2-8f0aacbfa7c6', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6310d5a1-eb0d-4e3c-9ffc-7a1cdee7677f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:19 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Volume volume-576e3812-0946-4e76-b6c2-8f0aacbfa7c6 (576e3812-0946-4e76-b6c2-8f0aacbfa7c6): created successfully Jul 08 01:27:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6310d5a1-eb0d-4e3c-9ffc-7a1cdee7677f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Flow 'volume_create_manager' (dd413caf-05cc-4175-8cee-b77408df16e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:19 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-bb057c00-88e5-4cc0-adfd-bf1575c38f2a tempest-CreateVolumesFromImageTest-1504584959 None] Created volume successfully. Jul 08 01:27:20 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c90f89-0971-4104-acb7-ed28edd8a384_mk_b66ordevstack@QuobyteHD Jul 08 01:27:20 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:20 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c90f89-0971-4104-acb7-ed28edd8a384_mk_b66ordevstack@QuobyteHD" returned: 1 in 0.757s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c90f89-0971-4104-acb7-ed28edd8a384_mk_b66ordevstack@QuobyteHD' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:27:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:20 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cd0cca02-329c-4faa-a527-4f8b2a8a6272 1073741824" returned: 0 in 0.863s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cd0cca02-329c-4faa-a527-4f8b2a8a6272 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:20 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cd0cca02-329c-4faa-a527-4f8b2a8a6272 Jul 08 01:27:20 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:21 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cd0cca02-329c-4faa-a527-4f8b2a8a6272" returned: 0 in 0.624s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:27:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.943s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1431190543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce53e7b5-d664-46f9-8ffa-993d3b0b8e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4261bf8c2f7c43c2ae1ea916cdaf4831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:14Z,use_quota=True,user_id='ada7289d1e83486089398851d001832d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:27:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Creating volume ce53e7b5-d664-46f9-8ffa-993d3b0b8e2b {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:27:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:27:21 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:27:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ce53e7b5-d664-46f9-8ffa-993d3b0b8e2b 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17e15da-7256-421d-8506-3b96c801ee9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd0cca02-329c-4faa-a527-4f8b2a8a6272', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:21 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ce53e7b5-d664-46f9-8ffa-993d3b0b8e2b 1073741824 Jul 08 01:27:21 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0cf22b0-9ebf-4a7f-9bde-8179f3ebe260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:21 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Volume volume-cd0cca02-329c-4faa-a527-4f8b2a8a6272 (cd0cca02-329c-4faa-a527-4f8b2a8a6272): created successfully Jul 08 01:27:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0cf22b0-9ebf-4a7f-9bde-8179f3ebe260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Flow 'volume_create_manager' (1e6524a2-f1f5-4849-8ab3-e07fa6d76974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:21 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-a4965361-c7b7-4283-ba62-ea497c02f0a9 tempest-CreateVolumesFromImageTest-1504584959 None] Created volume successfully. Jul 08 01:27:22 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ce53e7b5-d664-46f9-8ffa-993d3b0b8e2b 1073741824" returned: 0 in 0.816s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ce53e7b5-d664-46f9-8ffa-993d3b0b8e2b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:22 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ce53e7b5-d664-46f9-8ffa-993d3b0b8e2b Jul 08 01:27:22 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:22 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ce53e7b5-d664-46f9-8ffa-993d3b0b8e2b" returned: 0 in 0.646s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:22 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:27:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.940s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:22 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-757603392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=196d0e6a-f911-441b-8f55-6beda1aea701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4261bf8c2f7c43c2ae1ea916cdaf4831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:15Z,use_quota=True,user_id='ada7289d1e83486089398851d001832d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:27:22 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Creating volume 196d0e6a-f911-441b-8f55-6beda1aea701 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:27:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:22 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:22 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:22 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:27:22 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:27:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-196d0e6a-f911-441b-8f55-6beda1aea701 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:22 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-196d0e6a-f911-441b-8f55-6beda1aea701 1073741824 Jul 08 01:27:22 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:22 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (139d46f6-f88b-44b3-89b9-aa621eb62b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce53e7b5-d664-46f9-8ffa-993d3b0b8e2b', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:22 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a39abc-aae6-426f-a118-760421602262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:22 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Volume volume-ce53e7b5-d664-46f9-8ffa-993d3b0b8e2b (ce53e7b5-d664-46f9-8ffa-993d3b0b8e2b): created successfully Jul 08 01:27:22 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a39abc-aae6-426f-a118-760421602262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Flow 'volume_create_manager' (7d25f45a-975e-4895-83c0-7c8e2546fad7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:23 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-4cdc93db-f550-4a26-9057-4245dcbfebf2 tempest-CreateVolumesFromImageTest-1504584959 None] Created volume successfully. Jul 08 01:27:23 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-196d0e6a-f911-441b-8f55-6beda1aea701 1073741824" returned: 0 in 0.856s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-196d0e6a-f911-441b-8f55-6beda1aea701 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:23 devstack sudo[104719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-196d0e6a-f911-441b-8f55-6beda1aea701 Jul 08 01:27:23 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:24 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-196d0e6a-f911-441b-8f55-6beda1aea701" returned: 0 in 0.677s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:27:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-094e2f8b-8752-41b1-9398-9798c79d5b71 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.552s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31552ee5-98fc-4311-b260-aaf756435672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-196d0e6a-f911-441b-8f55-6beda1aea701', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f387bab-805d-4dcb-a40f-539c23ce43c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-094e2f8b-8752-41b1-9398-9798c79d5b71 tempest-CreateVolumesFromSnapshotTest-414282402 None] Creating offline snapshot 89da8d23-3c9c-484d-ac04-cd5b7dea4a82 of volume aec08254-83de-4049-8a62-4dba35bcaabd {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:27:24 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Volume volume-196d0e6a-f911-441b-8f55-6beda1aea701 (196d0e6a-f911-441b-8f55-6beda1aea701): created successfully Jul 08 01:27:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f387bab-805d-4dcb-a40f-539c23ce43c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Flow 'volume_create_manager' (9bed1bed-5983-4ccd-9e75-f527c27e5e82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:24 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[47210473-75e6-4d19-b274-2411407953f3]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-094e2f8b-8752-41b1-9398-9798c79d5b71 tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:24 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-7c4f9cf5-6269-4c25-bdd9-f9be8592831d tempest-CreateVolumesFromImageTest-1504584959 None] Created volume successfully. Jul 08 01:27:24 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd Jul 08 01:27:24 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:25 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-094e2f8b-8752-41b1-9398-9798c79d5b71 tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd" returned: 0 in 0.788s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-094e2f8b-8752-41b1-9398-9798c79d5b71 tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd.89da8d23-3c9c-484d-ac04-cd5b7dea4a82 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:25 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd.89da8d23-3c9c-484d-ac04-cd5b7dea4a82 1G Jul 08 01:27:25 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ee654a6e-138f-4fb0-a091-d5226b8360f6 tempest-CreateVolumesFromImageTest-1504584959 None] Acquiring lock "cinder-196d0e6a-f911-441b-8f55-6beda1aea701-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ee654a6e-138f-4fb0-a091-d5226b8360f6 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "cinder-196d0e6a-f911-441b-8f55-6beda1aea701-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ee654a6e-138f-4fb0-a091-d5226b8360f6 tempest-CreateVolumesFromImageTest-1504584959 None] Acquiring lock "cinder-quobyte-196d0e6a-f911-441b-8f55-6beda1aea701" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ee654a6e-138f-4fb0-a091-d5226b8360f6 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "cinder-quobyte-196d0e6a-f911-441b-8f55-6beda1aea701" acquired by "delete_volume" :: waited 0.026s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:25 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9be9c5-65ef-47e1-b616-32264483dcf6]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ee654a6e-138f-4fb0-a091-d5226b8360f6 tempest-CreateVolumesFromImageTest-1504584959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-196d0e6a-f911-441b-8f55-6beda1aea701 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:25 devstack sudo[104729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-196d0e6a-f911-441b-8f55-6beda1aea701 Jul 08 01:27:25 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:26 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-094e2f8b-8752-41b1-9398-9798c79d5b71 tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd.89da8d23-3c9c-484d-ac04-cd5b7dea4a82 1G" returned: 0 in 0.847s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-094e2f8b-8752-41b1-9398-9798c79d5b71 tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aec08254-83de-4049-8a62-4dba35bcaabd -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd.89da8d23-3c9c-484d-ac04-cd5b7dea4a82 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:26 devstack sudo[104735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aec08254-83de-4049-8a62-4dba35bcaabd -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd.89da8d23-3c9c-484d-ac04-cd5b7dea4a82 Jul 08 01:27:26 devstack sudo[104735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:26 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ee654a6e-138f-4fb0-a091-d5226b8360f6 tempest-CreateVolumesFromImageTest-1504584959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-196d0e6a-f911-441b-8f55-6beda1aea701" returned: 0 in 0.819s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ee654a6e-138f-4fb0-a091-d5226b8360f6 tempest-CreateVolumesFromImageTest-1504584959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-196d0e6a-f911-441b-8f55-6beda1aea701 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:26 devstack sudo[104740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-196d0e6a-f911-441b-8f55-6beda1aea701 Jul 08 01:27:26 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:26 devstack sudo[104735]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-094e2f8b-8752-41b1-9398-9798c79d5b71 tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aec08254-83de-4049-8a62-4dba35bcaabd -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd.89da8d23-3c9c-484d-ac04-cd5b7dea4a82" returned: 0 in 0.769s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:26 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-094e2f8b-8752-41b1-9398-9798c79d5b71 tempest-CreateVolumesFromSnapshotTest-414282402 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd.89da8d23-3c9c-484d-ac04-cd5b7dea4a82 is being set with open permissions: ugo+rw Jul 08 01:27:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-094e2f8b-8752-41b1-9398-9798c79d5b71 tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd.89da8d23-3c9c-484d-ac04-cd5b7dea4a82 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:27 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd.89da8d23-3c9c-484d-ac04-cd5b7dea4a82 Jul 08 01:27:27 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:27 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ee654a6e-138f-4fb0-a091-d5226b8360f6 tempest-CreateVolumesFromImageTest-1504584959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-196d0e6a-f911-441b-8f55-6beda1aea701" returned: 0 in 0.672s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ee654a6e-138f-4fb0-a091-d5226b8360f6 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "cinder-quobyte-196d0e6a-f911-441b-8f55-6beda1aea701" released by "delete_volume" :: held 1.547s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:27 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-ee654a6e-138f-4fb0-a091-d5226b8360f6 tempest-CreateVolumesFromImageTest-1504584959 None] Created reservations ['d909879b-760c-4060-adef-ec2a525e107a', '811338ef-f5d3-46a0-a8fa-c5577027cfeb', 'd7b9bd2e-07d1-4745-a0e7-bcfa29d15fe8', '7a7af9d3-f0e0-4603-be96-3d3d165cad79'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ee654a6e-138f-4fb0-a091-d5226b8360f6 tempest-CreateVolumesFromImageTest-1504584959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ee654a6e-138f-4fb0-a091-d5226b8360f6 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ee654a6e-138f-4fb0-a091-d5226b8360f6 tempest-CreateVolumesFromImageTest-1504584959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ee654a6e-138f-4fb0-a091-d5226b8360f6 tempest-CreateVolumesFromImageTest-1504584959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ee654a6e-138f-4fb0-a091-d5226b8360f6 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ee654a6e-138f-4fb0-a091-d5226b8360f6 tempest-CreateVolumesFromImageTest-1504584959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:27 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:27:27 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:27 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-094e2f8b-8752-41b1-9398-9798c79d5b71 tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd.89da8d23-3c9c-484d-ac04-cd5b7dea4a82" returned: 0 in 0.661s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-094e2f8b-8752-41b1-9398-9798c79d5b71 tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:27 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd.info Jul 08 01:27:27 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-798a49da-3a85-4810-b32a-2b97c985d200 tempest-CreateVolumesFromImageTest-1504584959 None] Acquiring lock "cinder-ce53e7b5-d664-46f9-8ffa-993d3b0b8e2b-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-798a49da-3a85-4810-b32a-2b97c985d200 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "cinder-ce53e7b5-d664-46f9-8ffa-993d3b0b8e2b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-798a49da-3a85-4810-b32a-2b97c985d200 tempest-CreateVolumesFromImageTest-1504584959 None] Acquiring lock "cinder-quobyte-ce53e7b5-d664-46f9-8ffa-993d3b0b8e2b" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-798a49da-3a85-4810-b32a-2b97c985d200 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "cinder-quobyte-ce53e7b5-d664-46f9-8ffa-993d3b0b8e2b" acquired by "delete_volume" :: waited 0.016s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:28 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8dced0-8d48-43b1-b535-3cf61d531686]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-798a49da-3a85-4810-b32a-2b97c985d200 tempest-CreateVolumesFromImageTest-1504584959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ce53e7b5-d664-46f9-8ffa-993d3b0b8e2b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:28 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ee654a6e-138f-4fb0-a091-d5226b8360f6 tempest-CreateVolumesFromImageTest-1504584959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.704s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:28 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-ee654a6e-138f-4fb0-a091-d5226b8360f6 tempest-CreateVolumesFromImageTest-1504584959 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:27:28 devstack sudo[104755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ce53e7b5-d664-46f9-8ffa-993d3b0b8e2b Jul 08 01:27:28 devstack sudo[104755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:28 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-ee654a6e-138f-4fb0-a091-d5226b8360f6 tempest-CreateVolumesFromImageTest-1504584959 None] Deleted volume successfully. Jul 08 01:27:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ee654a6e-138f-4fb0-a091-d5226b8360f6 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "cinder-196d0e6a-f911-441b-8f55-6beda1aea701-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:28 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-094e2f8b-8752-41b1-9398-9798c79d5b71 tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd.info" returned: 0 in 0.755s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:28 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-094e2f8b-8752-41b1-9398-9798c79d5b71 tempest-CreateVolumesFromSnapshotTest-414282402 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd.info is being set with open permissions: ugo+rw Jul 08 01:27:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-094e2f8b-8752-41b1-9398-9798c79d5b71 tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:28 devstack sudo[104758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd.info Jul 08 01:27:28 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:28 devstack sudo[104755]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-798a49da-3a85-4810-b32a-2b97c985d200 tempest-CreateVolumesFromImageTest-1504584959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ce53e7b5-d664-46f9-8ffa-993d3b0b8e2b" returned: 0 in 0.820s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-798a49da-3a85-4810-b32a-2b97c985d200 tempest-CreateVolumesFromImageTest-1504584959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ce53e7b5-d664-46f9-8ffa-993d3b0b8e2b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:28 devstack sudo[104763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ce53e7b5-d664-46f9-8ffa-993d3b0b8e2b Jul 08 01:27:28 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:29 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-094e2f8b-8752-41b1-9398-9798c79d5b71 tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd.info" returned: 0 in 0.626s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-094e2f8b-8752-41b1-9398-9798c79d5b71 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.595s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.541s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-645165636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f899eee5-8e53-40cd-a37d-cadf20aa30e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863b23cdc3d543c4a92039107758fc14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:17Z,use_quota=True,user_id='8c89f88250a841129760707665e78c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:27:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Creating volume f899eee5-8e53-40cd-a37d-cadf20aa30e8 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:27:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:27:29 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:27:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:29 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8 1073741824 Jul 08 01:27:29 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:29 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-094e2f8b-8752-41b1-9398-9798c79d5b71 tempest-CreateVolumesFromSnapshotTest-414282402 None] Create snapshot completed successfully Jul 08 01:27:29 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-798a49da-3a85-4810-b32a-2b97c985d200 tempest-CreateVolumesFromImageTest-1504584959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ce53e7b5-d664-46f9-8ffa-993d3b0b8e2b" returned: 0 in 0.673s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:29 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-798a49da-3a85-4810-b32a-2b97c985d200 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "cinder-quobyte-ce53e7b5-d664-46f9-8ffa-993d3b0b8e2b" released by "delete_volume" :: held 1.552s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:29 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-798a49da-3a85-4810-b32a-2b97c985d200 tempest-CreateVolumesFromImageTest-1504584959 None] Created reservations ['9b559d18-f393-406c-a0d0-65ea2c37cf96', '046206ec-767b-404c-a2e6-5f0326288e09', '7dc0bdb9-0119-47d4-afb3-abe366284909', 'bd796515-7873-4b73-9aae-3cab98ec7a8d'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-798a49da-3a85-4810-b32a-2b97c985d200 tempest-CreateVolumesFromImageTest-1504584959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-798a49da-3a85-4810-b32a-2b97c985d200 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-798a49da-3a85-4810-b32a-2b97c985d200 tempest-CreateVolumesFromImageTest-1504584959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-798a49da-3a85-4810-b32a-2b97c985d200 tempest-CreateVolumesFromImageTest-1504584959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-798a49da-3a85-4810-b32a-2b97c985d200 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-798a49da-3a85-4810-b32a-2b97c985d200 tempest-CreateVolumesFromImageTest-1504584959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:29 devstack sudo[104772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:27:29 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:29 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:27:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Flow 'volume_create_manager' (3bc4a34c-1965-427f-98e7-c57dfffde9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae177a3b-82ff-4cb9-bea3-84082f5e9b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae177a3b-82ff-4cb9-bea3-84082f5e9b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-532262831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c529778b-4856-4d9a-94de-f9479b19ea8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d4b3b364bc4a109a8839709009be1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:30Z,use_quota=True,user_id='458e0a86b626433bb89eefdd91bdc079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6753d8ef-43d8-4073-9729-566db3f8f256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6753d8ef-43d8-4073-9729-566db3f8f256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ab4250e-f37b-4b68-b3a6-79b9f5cd2342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ab4250e-f37b-4b68-b3a6-79b9f5cd2342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c529778b-4856-4d9a-94de-f9479b19ea8b', 'volume_name': 'volume-c529778b-4856-4d9a-94de-f9479b19ea8b', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f8c6cbe-0c49-4347-b8e6-c408d0f3c1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f8c6cbe-0c49-4347-b8e6-c408d0f3c1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00c68136-87e3-49bb-882b-f7cef0efcd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:30 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Volume c529778b-4856-4d9a-94de-f9479b19ea8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c529778b-4856-4d9a-94de-f9479b19ea8b', 'volume_size': 1} Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:30 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8 1073741824" returned: 0 in 1.069s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:30 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8 Jul 08 01:27:30 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e84155d8-5e11-4178-aae4-aa22e9efbc78 tempest-CreateVolumesFromImageTest-1504584959 None] Acquiring lock "cinder-cd0cca02-329c-4faa-a527-4f8b2a8a6272-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e84155d8-5e11-4178-aae4-aa22e9efbc78 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "cinder-cd0cca02-329c-4faa-a527-4f8b2a8a6272-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e84155d8-5e11-4178-aae4-aa22e9efbc78 tempest-CreateVolumesFromImageTest-1504584959 None] Acquiring lock "cinder-quobyte-cd0cca02-329c-4faa-a527-4f8b2a8a6272" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Flow 'volume_create_manager' (b61c0a23-ed3f-48ea-88d8-d1614ba9eb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63cc3581-3d9b-47e8-8106-8fc5d78486dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e84155d8-5e11-4178-aae4-aa22e9efbc78 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "cinder-quobyte-cd0cca02-329c-4faa-a527-4f8b2a8a6272" acquired by "delete_volume" :: waited 0.078s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63cc3581-3d9b-47e8-8106-8fc5d78486dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1948661215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a98727bc-e799-4985-8083-cdf7b24b611f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d4b3b364bc4a109a8839709009be1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:30Z,use_quota=True,user_id='458e0a86b626433bb89eefdd91bdc079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6ab483-aecf-4ee9-9c8b-e1908de37a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6ab483-aecf-4ee9-9c8b-e1908de37a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b640625f-a37b-4175-b756-269ea9455f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b640625f-a37b-4175-b756-269ea9455f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a98727bc-e799-4985-8083-cdf7b24b611f', 'volume_name': 'volume-a98727bc-e799-4985-8083-cdf7b24b611f', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d656f48-bc9b-4d5b-b9a1-207afd3ed3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d656f48-bc9b-4d5b-b9a1-207afd3ed3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c95056-ecad-4e8d-ad3f-7d23f8c01fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:30 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Volume a98727bc-e799-4985-8083-cdf7b24b611f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a98727bc-e799-4985-8083-cdf7b24b611f', 'volume_size': 1} Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7dd5746-0a8b-4818-9ec6-9154cb6a5ef9]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e84155d8-5e11-4178-aae4-aa22e9efbc78 tempest-CreateVolumesFromImageTest-1504584959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cd0cca02-329c-4faa-a527-4f8b2a8a6272 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:30 devstack sudo[104777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cd0cca02-329c-4faa-a527-4f8b2a8a6272 Jul 08 01:27:30 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:30 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-798a49da-3a85-4810-b32a-2b97c985d200 tempest-CreateVolumesFromImageTest-1504584959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.024s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-798a49da-3a85-4810-b32a-2b97c985d200 tempest-CreateVolumesFromImageTest-1504584959 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:27:30 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-798a49da-3a85-4810-b32a-2b97c985d200 tempest-CreateVolumesFromImageTest-1504584959 None] Deleted volume successfully. Jul 08 01:27:30 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-798a49da-3a85-4810-b32a-2b97c985d200 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "cinder-ce53e7b5-d664-46f9-8ffa-993d3b0b8e2b-delete_volume" released by "delete_volume" :: held 2.839s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Flow 'volume_create_manager' (deb99606-c024-4468-8d44-b647df10bab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b7258b-690b-4b09-89ae-d7201f8b0fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b7258b-690b-4b09-89ae-d7201f8b0fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-296608243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=895315d7-f9ab-44f4-bed2-4c281a62d5a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d4b3b364bc4a109a8839709009be1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:31Z,use_quota=True,user_id='458e0a86b626433bb89eefdd91bdc079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c339e1a-db14-47e6-a2a5-c225037bda74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c339e1a-db14-47e6-a2a5-c225037bda74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da2f3755-912a-421e-8ade-1d1a40f46f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da2f3755-912a-421e-8ade-1d1a40f46f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '895315d7-f9ab-44f4-bed2-4c281a62d5a0', 'volume_name': 'volume-895315d7-f9ab-44f4-bed2-4c281a62d5a0', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919994bf-bf25-496c-9ead-bcefead0a5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919994bf-bf25-496c-9ead-bcefead0a5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae081b3-5574-4bc7-973a-6db4d3399524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:31 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Volume 895315d7-f9ab-44f4-bed2-4c281a62d5a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-895315d7-f9ab-44f4-bed2-4c281a62d5a0', 'volume_size': 1} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:31 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8" returned: 0 in 0.968s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] <== create_volume: return (2107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.112s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.562s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7502386e-07eb-4429-a636-0621c193cf21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c3b7ef3b314787999182f342b68712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:17Z,use_quota=True,user_id='5d44b58eae4a412db86e70ac5d890dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc1c387f-2c19-4e1e-9213-92df21c93db6),volume_type_id=cc1c387f-2c19-4e1e-9213-92df21c93db6)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Creating volume 7502386e-07eb-4429-a636-0621c193cf21 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:27:31 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:31 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21 1073741824 Jul 08 01:27:31 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b08cdf5-0435-4650-8ddc-b94f68ba2926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85fca068-78eb-461d-b3f6-fc064055b8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:31 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Volume volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8 (f899eee5-8e53-40cd-a37d-cadf20aa30e8): created successfully Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85fca068-78eb-461d-b3f6-fc064055b8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Flow 'volume_create_manager' (1fc24d72-4a2b-4699-a506-8ff1a31e502f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:31 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-f50f77f0-d24c-4ac7-8cc9-b32182ee2da1 tempest-CinderUnicodeTest-1134404644 None] Created volume successfully. Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Flow 'volume_create_manager' (c7f3b41a-3cf4-485f-9002-7d012bb7fdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8395e14a-157e-4b9e-a502-b108e8474030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8395e14a-157e-4b9e-a502-b108e8474030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1759469204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c07248f0-6b1c-4aa9-9206-f3e89dfce405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d4b3b364bc4a109a8839709009be1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:31Z,use_quota=True,user_id='458e0a86b626433bb89eefdd91bdc079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df79b7b7-87af-4f91-a11d-c42251b9f518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df79b7b7-87af-4f91-a11d-c42251b9f518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adc350e6-f1ee-4e5b-b3a1-17caa65e58c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adc350e6-f1ee-4e5b-b3a1-17caa65e58c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c07248f0-6b1c-4aa9-9206-f3e89dfce405', 'volume_name': 'volume-c07248f0-6b1c-4aa9-9206-f3e89dfce405', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ed85293-b427-450f-86b9-1cf768b0974c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ed85293-b427-450f-86b9-1cf768b0974c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9590ebd6-e2fc-46b4-b940-12422f7d4c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:31 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Volume c07248f0-6b1c-4aa9-9206-f3e89dfce405: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c07248f0-6b1c-4aa9-9206-f3e89dfce405', 'volume_size': 1} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:31 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e84155d8-5e11-4178-aae4-aa22e9efbc78 tempest-CreateVolumesFromImageTest-1504584959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cd0cca02-329c-4faa-a527-4f8b2a8a6272" returned: 0 in 1.193s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e84155d8-5e11-4178-aae4-aa22e9efbc78 tempest-CreateVolumesFromImageTest-1504584959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cd0cca02-329c-4faa-a527-4f8b2a8a6272 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:31 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cd0cca02-329c-4faa-a527-4f8b2a8a6272 Jul 08 01:27:31 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:32 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:27:32 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Flow 'volume_create_manager' (6c271e1e-30f8-4c8c-b5f0-39ed1061b30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:32 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25953a66-4189-4edc-a85a-bda8f0b5efe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:32 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25953a66-4189-4edc-a85a-bda8f0b5efe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-102439719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e1c3da-9e6e-42b6-91db-98c1b8de0308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d4b3b364bc4a109a8839709009be1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:32Z,use_quota=True,user_id='458e0a86b626433bb89eefdd91bdc079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:32 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac34b615-5f1e-4abe-b06a-8c925ba8818e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:32 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac34b615-5f1e-4abe-b06a-8c925ba8818e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:32 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4af889-8a19-45c6-9ce6-d9b656009b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:32 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4af889-8a19-45c6-9ce6-d9b656009b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56e1c3da-9e6e-42b6-91db-98c1b8de0308', 'volume_name': 'volume-56e1c3da-9e6e-42b6-91db-98c1b8de0308', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:32 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71150d65-103b-43a4-8aa9-1b90e355569e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:32 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71150d65-103b-43a4-8aa9-1b90e355569e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:32 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb95178-6ce4-45d0-916d-1d11d8fe9ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:32 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Volume 56e1c3da-9e6e-42b6-91db-98c1b8de0308: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56e1c3da-9e6e-42b6-91db-98c1b8de0308', 'volume_size': 1} Jul 08 01:27:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:32 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21 1073741824" returned: 0 in 1.096s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:32 devstack sudo[104791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21 Jul 08 01:27:32 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:32 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e84155d8-5e11-4178-aae4-aa22e9efbc78 tempest-CreateVolumesFromImageTest-1504584959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cd0cca02-329c-4faa-a527-4f8b2a8a6272" returned: 0 in 0.772s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:32 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e84155d8-5e11-4178-aae4-aa22e9efbc78 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "cinder-quobyte-cd0cca02-329c-4faa-a527-4f8b2a8a6272" released by "delete_volume" :: held 2.089s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:32 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-e84155d8-5e11-4178-aae4-aa22e9efbc78 tempest-CreateVolumesFromImageTest-1504584959 None] Created reservations ['32951a55-07be-4141-8cfb-126abec68d5d', 'e38f7a89-1c2f-4e0b-9b3b-e0026c5edf80', '1fee1e1f-7794-45f7-b85f-c6506f26c717', 'b52b3e74-75d5-46f6-af12-c0fbdac2b03d'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e84155d8-5e11-4178-aae4-aa22e9efbc78 tempest-CreateVolumesFromImageTest-1504584959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e84155d8-5e11-4178-aae4-aa22e9efbc78 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:32 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e84155d8-5e11-4178-aae4-aa22e9efbc78 tempest-CreateVolumesFromImageTest-1504584959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:32 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e84155d8-5e11-4178-aae4-aa22e9efbc78 tempest-CreateVolumesFromImageTest-1504584959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e84155d8-5e11-4178-aae4-aa22e9efbc78 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e84155d8-5e11-4178-aae4-aa22e9efbc78 tempest-CreateVolumesFromImageTest-1504584959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:32 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:27:32 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b385195a-221b-4c3f-886f-97a123c673e3 tempest-CinderUnicodeTest-1134404644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:33 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21" returned: 0 in 0.716s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:33 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] <== create_volume: return (1885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:27:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.059s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:33 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-532262831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c529778b-4856-4d9a-94de-f9479b19ea8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d4b3b364bc4a109a8839709009be1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:30Z,use_quota=True,user_id='458e0a86b626433bb89eefdd91bdc079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:27:33 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Creating volume c529778b-4856-4d9a-94de-f9479b19ea8b {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:27:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:33 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:33 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:33 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:27:33 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:27:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c529778b-4856-4d9a-94de-f9479b19ea8b 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:33 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c529778b-4856-4d9a-94de-f9479b19ea8b 1073741824 Jul 08 01:27:33 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:33 devstack cinder-volume[87022]: DEBUG cinder.volume.volume_utils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Attempting download of b7c90f89-0971-4104-acb7-ed28edd8a384 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7c90f89-0971-4104-acb7-ed28edd8a384', 'metadata': {}}])) to volume 7502386e-07eb-4429-a636-0621c193cf21. {{(pid=87022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:27:33 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[790cd3e8-3ab5-4930-a99f-8e67454becd8]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7c90f89-0971-4104-acb7-ed28edd8a384_9eh4mpuq {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:33 devstack sudo[104799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7c90f89-0971-4104-acb7-ed28edd8a384_9eh4mpuq Jul 08 01:27:33 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:33 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e84155d8-5e11-4178-aae4-aa22e9efbc78 tempest-CreateVolumesFromImageTest-1504584959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.664s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:33 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-e84155d8-5e11-4178-aae4-aa22e9efbc78 tempest-CreateVolumesFromImageTest-1504584959 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:27:33 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-e84155d8-5e11-4178-aae4-aa22e9efbc78 tempest-CreateVolumesFromImageTest-1504584959 None] Deleted volume successfully. Jul 08 01:27:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e84155d8-5e11-4178-aae4-aa22e9efbc78 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "cinder-cd0cca02-329c-4faa-a527-4f8b2a8a6272-delete_volume" released by "delete_volume" :: held 3.137s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-27bb74a0-114a-47d6-8620-c5bc7813478d tempest-CreateVolumesFromImageTest-1504584959 None] Acquiring lock "cinder-576e3812-0946-4e76-b6c2-8f0aacbfa7c6-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-27bb74a0-114a-47d6-8620-c5bc7813478d tempest-CreateVolumesFromImageTest-1504584959 None] Lock "cinder-576e3812-0946-4e76-b6c2-8f0aacbfa7c6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-27bb74a0-114a-47d6-8620-c5bc7813478d tempest-CreateVolumesFromImageTest-1504584959 None] Acquiring lock "cinder-quobyte-576e3812-0946-4e76-b6c2-8f0aacbfa7c6" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-27bb74a0-114a-47d6-8620-c5bc7813478d tempest-CreateVolumesFromImageTest-1504584959 None] Lock "cinder-quobyte-576e3812-0946-4e76-b6c2-8f0aacbfa7c6" acquired by "delete_volume" :: waited 0.023s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:33 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f53a32-7bf1-4aea-b691-a901f6158430]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-27bb74a0-114a-47d6-8620-c5bc7813478d tempest-CreateVolumesFromImageTest-1504584959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-576e3812-0946-4e76-b6c2-8f0aacbfa7c6 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:34 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:34 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-576e3812-0946-4e76-b6c2-8f0aacbfa7c6 Jul 08 01:27:34 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7c90f89-0971-4104-acb7-ed28edd8a384_9eh4mpuq" returned: 0 in 0.794s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7c90f89-0971-4104-acb7-ed28edd8a384_9eh4mpuq {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:34 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c529778b-4856-4d9a-94de-f9479b19ea8b 1073741824" returned: 0 in 0.966s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c529778b-4856-4d9a-94de-f9479b19ea8b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:34 devstack sudo[104810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7c90f89-0971-4104-acb7-ed28edd8a384_9eh4mpuq Jul 08 01:27:34 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:34 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c529778b-4856-4d9a-94de-f9479b19ea8b Jul 08 01:27:34 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:34 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-27bb74a0-114a-47d6-8620-c5bc7813478d tempest-CreateVolumesFromImageTest-1504584959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-576e3812-0946-4e76-b6c2-8f0aacbfa7c6" returned: 0 in 0.771s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-27bb74a0-114a-47d6-8620-c5bc7813478d tempest-CreateVolumesFromImageTest-1504584959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-576e3812-0946-4e76-b6c2-8f0aacbfa7c6 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:34 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-576e3812-0946-4e76-b6c2-8f0aacbfa7c6 Jul 08 01:27:34 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:34 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:34 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7c90f89-0971-4104-acb7-ed28edd8a384_9eh4mpuq" returned: 1 in 0.791s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7c90f89-0971-4104-acb7-ed28edd8a384_9eh4mpuq' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:27:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c529778b-4856-4d9a-94de-f9479b19ea8b" returned: 0 in 0.676s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:34 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:27:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:34 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7ce8d9-010c-46df-a5d7-62a658ea6f55]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.206s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:34 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1948661215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a98727bc-e799-4985-8083-cdf7b24b611f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d4b3b364bc4a109a8839709009be1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:30Z,use_quota=True,user_id='458e0a86b626433bb89eefdd91bdc079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:27:34 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Creating volume a98727bc-e799-4985-8083-cdf7b24b611f {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:27:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:34 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:34 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:34 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:27:34 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:27:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a98727bc-e799-4985-8083-cdf7b24b611f 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c90f89-0971-4104-acb7-ed28edd8a384_mk_b66ordevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:34 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a98727bc-e799-4985-8083-cdf7b24b611f 1073741824 Jul 08 01:27:34 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:34 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00c68136-87e3-49bb-882b-f7cef0efcd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c529778b-4856-4d9a-94de-f9479b19ea8b', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:34 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c5de46-df4c-412b-8a66-531feeeb5372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:34 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Volume volume-c529778b-4856-4d9a-94de-f9479b19ea8b (c529778b-4856-4d9a-94de-f9479b19ea8b): created successfully Jul 08 01:27:34 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c5de46-df4c-412b-8a66-531feeeb5372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:34 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Flow 'volume_create_manager' (3bc4a34c-1965-427f-98e7-c57dfffde9c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:34 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-b355bef7-c813-4699-b047-fdf122d29033 tempest-CreateVolumesFromSnapshotTest-414282402 None] Created volume successfully. Jul 08 01:27:35 devstack sudo[104823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c90f89-0971-4104-acb7-ed28edd8a384_mk_b66ordevstack@QuobyteHD Jul 08 01:27:35 devstack sudo[104823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:35 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-27bb74a0-114a-47d6-8620-c5bc7813478d tempest-CreateVolumesFromImageTest-1504584959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-576e3812-0946-4e76-b6c2-8f0aacbfa7c6" returned: 0 in 0.653s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-27bb74a0-114a-47d6-8620-c5bc7813478d tempest-CreateVolumesFromImageTest-1504584959 None] Lock "cinder-quobyte-576e3812-0946-4e76-b6c2-8f0aacbfa7c6" released by "delete_volume" :: held 1.459s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:35 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-27bb74a0-114a-47d6-8620-c5bc7813478d tempest-CreateVolumesFromImageTest-1504584959 None] Created reservations ['af35edce-774d-4978-af69-5a1eff900af6', '9eac92a2-8bc1-47a5-96e9-d2c7531bdcb6', '8989d01c-d57b-4027-95cf-c1f9ee51ac11', '43d10bef-c97e-43d2-aa7c-7c75dd556a2f'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-27bb74a0-114a-47d6-8620-c5bc7813478d tempest-CreateVolumesFromImageTest-1504584959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-27bb74a0-114a-47d6-8620-c5bc7813478d tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:35 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-27bb74a0-114a-47d6-8620-c5bc7813478d tempest-CreateVolumesFromImageTest-1504584959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:35 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-27bb74a0-114a-47d6-8620-c5bc7813478d tempest-CreateVolumesFromImageTest-1504584959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-27bb74a0-114a-47d6-8620-c5bc7813478d tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-27bb74a0-114a-47d6-8620-c5bc7813478d tempest-CreateVolumesFromImageTest-1504584959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:35 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:27:35 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:35 devstack sudo[104823]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c90f89-0971-4104-acb7-ed28edd8a384_mk_b66ordevstack@QuobyteHD" returned: 0 in 0.851s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c90f89-0971-4104-acb7-ed28edd8a384_mk_b66ordevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:35 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c90f89-0971-4104-acb7-ed28edd8a384_mk_b66ordevstack@QuobyteHD Jul 08 01:27:35 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:35 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a98727bc-e799-4985-8083-cdf7b24b611f 1073741824" returned: 0 in 0.996s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a98727bc-e799-4985-8083-cdf7b24b611f {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:35 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a98727bc-e799-4985-8083-cdf7b24b611f Jul 08 01:27:35 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-75e2ed61-933b-4419-8210-02962c0569c4 tempest-CreateVolumesFromImageTest-1504584959 None] Acquiring lock "cinder-6549cb56-f990-406b-b8c2-2768a4fde927-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-75e2ed61-933b-4419-8210-02962c0569c4 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "cinder-6549cb56-f990-406b-b8c2-2768a4fde927-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-75e2ed61-933b-4419-8210-02962c0569c4 tempest-CreateVolumesFromImageTest-1504584959 None] Acquiring lock "cinder-quobyte-6549cb56-f990-406b-b8c2-2768a4fde927" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-75e2ed61-933b-4419-8210-02962c0569c4 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "cinder-quobyte-6549cb56-f990-406b-b8c2-2768a4fde927" acquired by "delete_volume" :: waited 0.018s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b35df9-651f-4611-b3ed-4091acd01082]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75e2ed61-933b-4419-8210-02962c0569c4 tempest-CreateVolumesFromImageTest-1504584959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6549cb56-f990-406b-b8c2-2768a4fde927 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:36 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-27bb74a0-114a-47d6-8620-c5bc7813478d tempest-CreateVolumesFromImageTest-1504584959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.806s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-27bb74a0-114a-47d6-8620-c5bc7813478d tempest-CreateVolumesFromImageTest-1504584959 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:27:36 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-27bb74a0-114a-47d6-8620-c5bc7813478d tempest-CreateVolumesFromImageTest-1504584959 None] Deleted volume successfully. Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-27bb74a0-114a-47d6-8620-c5bc7813478d tempest-CreateVolumesFromImageTest-1504584959 None] Lock "cinder-576e3812-0946-4e76-b6c2-8f0aacbfa7c6-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:36 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6549cb56-f990-406b-b8c2-2768a4fde927 Jul 08 01:27:36 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:36 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c90f89-0971-4104-acb7-ed28edd8a384_mk_b66ordevstack@QuobyteHD" returned: 1 in 0.816s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c90f89-0971-4104-acb7-ed28edd8a384_mk_b66ordevstack@QuobyteHD' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] b7c90f89-0971-4104-acb7-ed28edd8a384 was raw, converting to raw {{(pid=87022) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b7c90f89-0971-4104-acb7-ed28edd8a384_mk_b66ordevstack@QuobyteHD /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:36 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b7c90f89-0971-4104-acb7-ed28edd8a384_mk_b66ordevstack@QuobyteHD /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21 Jul 08 01:27:36 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:36 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a98727bc-e799-4985-8083-cdf7b24b611f" returned: 0 in 0.800s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] <== create_volume: return (1852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.582s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-296608243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=895315d7-f9ab-44f4-bed2-4c281a62d5a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d4b3b364bc4a109a8839709009be1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:31Z,use_quota=True,user_id='458e0a86b626433bb89eefdd91bdc079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Creating volume 895315d7-f9ab-44f4-bed2-4c281a62d5a0 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:27:36 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-895315d7-f9ab-44f4-bed2-4c281a62d5a0 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:36 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-895315d7-f9ab-44f4-bed2-4c281a62d5a0 1073741824 Jul 08 01:27:36 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c95056-ecad-4e8d-ad3f-7d23f8c01fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a98727bc-e799-4985-8083-cdf7b24b611f', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a0ba4a-b60c-431c-ae05-8e9cbd4ee010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:36 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Volume volume-a98727bc-e799-4985-8083-cdf7b24b611f (a98727bc-e799-4985-8083-cdf7b24b611f): created successfully Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a0ba4a-b60c-431c-ae05-8e9cbd4ee010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Flow 'volume_create_manager' (b61c0a23-ed3f-48ea-88d8-d1614ba9eb2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:36 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-0ac6b973-b9a6-44ea-b89f-60c64f2e3bdc tempest-CreateVolumesFromSnapshotTest-414282402 None] Created volume successfully. Jul 08 01:27:37 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75e2ed61-933b-4419-8210-02962c0569c4 tempest-CreateVolumesFromImageTest-1504584959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6549cb56-f990-406b-b8c2-2768a4fde927" returned: 0 in 0.872s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75e2ed61-933b-4419-8210-02962c0569c4 tempest-CreateVolumesFromImageTest-1504584959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6549cb56-f990-406b-b8c2-2768a4fde927 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:37 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6549cb56-f990-406b-b8c2-2768a4fde927 Jul 08 01:27:37 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:37 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b7c90f89-0971-4104-acb7-ed28edd8a384_mk_b66ordevstack@QuobyteHD /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21" returned: 0 in 0.835s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:37 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b7c90f89-0971-4104-acb7-ed28edd8a384_mk_b66ordevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21 {{(pid=87022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:27:37 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 01:27:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:37 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21 1G Jul 08 01:27:37 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:37 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-895315d7-f9ab-44f4-bed2-4c281a62d5a0 1073741824" returned: 0 in 0.931s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-895315d7-f9ab-44f4-bed2-4c281a62d5a0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:37 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-895315d7-f9ab-44f4-bed2-4c281a62d5a0 Jul 08 01:27:37 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:37 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75e2ed61-933b-4419-8210-02962c0569c4 tempest-CreateVolumesFromImageTest-1504584959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6549cb56-f990-406b-b8c2-2768a4fde927" returned: 0 in 0.695s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:37 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-75e2ed61-933b-4419-8210-02962c0569c4 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "cinder-quobyte-6549cb56-f990-406b-b8c2-2768a4fde927" released by "delete_volume" :: held 1.627s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:37 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-75e2ed61-933b-4419-8210-02962c0569c4 tempest-CreateVolumesFromImageTest-1504584959 None] Created reservations ['93435bfa-4921-472c-9f3c-6acf49f25316', '2e7bcd46-299f-47e7-a417-0f5931fc6f9b', '89f46ae7-a1c4-451f-8aef-4383fdb6a26b', '48dea52d-b110-44a0-a042-1ce2746a5719'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-75e2ed61-933b-4419-8210-02962c0569c4 tempest-CreateVolumesFromImageTest-1504584959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-75e2ed61-933b-4419-8210-02962c0569c4 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:37 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-75e2ed61-933b-4419-8210-02962c0569c4 tempest-CreateVolumesFromImageTest-1504584959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:37 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-75e2ed61-933b-4419-8210-02962c0569c4 tempest-CreateVolumesFromImageTest-1504584959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-75e2ed61-933b-4419-8210-02962c0569c4 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75e2ed61-933b-4419-8210-02962c0569c4 tempest-CreateVolumesFromImageTest-1504584959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:37 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:27:37 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:38 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21 1G" returned: 0 in 0.737s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:38 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87065a4-79a3-48d4-a7da-e10243716abf]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:38 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21 Jul 08 01:27:38 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:38 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-895315d7-f9ab-44f4-bed2-4c281a62d5a0" returned: 0 in 0.719s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:27:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.722s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1759469204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c07248f0-6b1c-4aa9-9206-f3e89dfce405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d4b3b364bc4a109a8839709009be1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:31Z,use_quota=True,user_id='458e0a86b626433bb89eefdd91bdc079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:27:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Creating volume c07248f0-6b1c-4aa9-9206-f3e89dfce405 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:27:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:27:38 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:27:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c07248f0-6b1c-4aa9-9206-f3e89dfce405 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae081b3-5574-4bc7-973a-6db4d3399524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-895315d7-f9ab-44f4-bed2-4c281a62d5a0', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:38 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c07248f0-6b1c-4aa9-9206-f3e89dfce405 1073741824 Jul 08 01:27:38 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95abbeb7-ce91-4c79-b081-577a137cbe78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:38 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Volume volume-895315d7-f9ab-44f4-bed2-4c281a62d5a0 (895315d7-f9ab-44f4-bed2-4c281a62d5a0): created successfully Jul 08 01:27:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95abbeb7-ce91-4c79-b081-577a137cbe78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Flow 'volume_create_manager' (deb99606-c024-4468-8d44-b647df10bab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:38 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-370664df-aec4-45a7-b530-eea877ddb833 tempest-CreateVolumesFromSnapshotTest-414282402 None] Created volume successfully. Jul 08 01:27:38 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-75e2ed61-933b-4419-8210-02962c0569c4 tempest-CreateVolumesFromImageTest-1504584959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.829s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:38 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-75e2ed61-933b-4419-8210-02962c0569c4 tempest-CreateVolumesFromImageTest-1504584959 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:27:38 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-75e2ed61-933b-4419-8210-02962c0569c4 tempest-CreateVolumesFromImageTest-1504584959 None] Deleted volume successfully. Jul 08 01:27:38 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-75e2ed61-933b-4419-8210-02962c0569c4 tempest-CreateVolumesFromImageTest-1504584959 None] Lock "cinder-6549cb56-f990-406b-b8c2-2768a4fde927-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:39 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21" returned: 0 in 0.896s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:39 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21 Jul 08 01:27:39 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:39 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c07248f0-6b1c-4aa9-9206-f3e89dfce405 1073741824" returned: 0 in 1.047s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c07248f0-6b1c-4aa9-9206-f3e89dfce405 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:39 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c07248f0-6b1c-4aa9-9206-f3e89dfce405 Jul 08 01:27:39 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:40 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21" returned: 1 in 0.942s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG cinder.volume.volume_utils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Downloaded image b7c90f89-0971-4104-acb7-ed28edd8a384 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7c90f89-0971-4104-acb7-ed28edd8a384', 'metadata': {}}])) to volume 7502386e-07eb-4429-a636-0621c193cf21 successfully. {{(pid=87022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Temporary image b7c90f89-0971-4104-acb7-ed28edd8a384 for user 5d44b58eae4a412db86e70ac5d890dfd is deleted. {{(pid=87022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG cinder.volume.volume_utils [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Marking volume 7502386e-07eb-4429-a636-0621c193cf21 as bootable. {{(pid=87022) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Copying metadata from image b7c90f89-0971-4104-acb7-ed28edd8a384 to 7502386e-07eb-4429-a636-0621c193cf21. {{(pid=87022) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Creating volume glance metadata for volume 7502386e-07eb-4429-a636-0621c193cf21 backed by image b7c90f89-0971-4104-acb7-ed28edd8a384 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b7c90f89-0971-4104-acb7-ed28edd8a384', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f274727823036322616b2fc0465662d7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87022) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29c277d-bcad-4a24-ab44-62301d38acc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7502386e-07eb-4429-a636-0621c193cf21', 'volume_size': 1, 'image_id': 'b7c90f89-0971-4104-acb7-ed28edd8a384', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7c90f89-0971-4104-acb7-ed28edd8a384', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f274727823036322616b2fc0465662d7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '63c3b7ef3b314787999182f342b68712', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '60377d026747c255c2bb34717d4a791a732602bd8e9b658bf8a7deffc0725493021584d0adc037dc652d4d125d5bb4c9ea952aa588d8e3949b245e70be9696ad', 'id': 'b7c90f89-0971-4104-acb7-ed28edd8a384', 'created_at': datetime.datetime(2026, 7, 7, 23, 27, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 27, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7c90f89-0971-4104-acb7-ed28edd8a384/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a3c9d51-98bd-4860-bec2-93eee14b2761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:40 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Volume volume-7502386e-07eb-4429-a636-0621c193cf21 (7502386e-07eb-4429-a636-0621c193cf21): created successfully Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a3c9d51-98bd-4860-bec2-93eee14b2761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Flow 'volume_create_manager' (66194a49-6320-4a6f-9773-33dc2aeb6924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:40 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-735648c0-19d9-4515-96e6-67426250e37b tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Created volume successfully. Jul 08 01:27:40 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c07248f0-6b1c-4aa9-9206-f3e89dfce405" returned: 0 in 0.726s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] <== create_volume: return (1835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.118s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-102439719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e1c3da-9e6e-42b6-91db-98c1b8de0308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d4b3b364bc4a109a8839709009be1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:32Z,use_quota=True,user_id='458e0a86b626433bb89eefdd91bdc079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Creating volume 56e1c3da-9e6e-42b6-91db-98c1b8de0308 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:27:40 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56e1c3da-9e6e-42b6-91db-98c1b8de0308 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:40 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56e1c3da-9e6e-42b6-91db-98c1b8de0308 1073741824 Jul 08 01:27:40 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9590ebd6-e2fc-46b4-b940-12422f7d4c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c07248f0-6b1c-4aa9-9206-f3e89dfce405', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (011a8d65-2cbd-47c5-b6bb-8685b1310f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:40 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Volume volume-c07248f0-6b1c-4aa9-9206-f3e89dfce405 (c07248f0-6b1c-4aa9-9206-f3e89dfce405): created successfully Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (011a8d65-2cbd-47c5-b6bb-8685b1310f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Flow 'volume_create_manager' (c7f3b41a-3cf4-485f-9002-7d012bb7fdec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:40 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-858c5163-59e6-4e06-be68-ef2d6bd5c64d tempest-CreateVolumesFromSnapshotTest-414282402 None] Created volume successfully. Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6b83a3f4-54bb-495a-80ae-a556533b80a6 tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Acquiring lock "cinder-7502386e-07eb-4429-a636-0621c193cf21-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6b83a3f4-54bb-495a-80ae-a556533b80a6 tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Lock "cinder-7502386e-07eb-4429-a636-0621c193cf21-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6b83a3f4-54bb-495a-80ae-a556533b80a6 tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Acquiring lock "cinder-quobyte-7502386e-07eb-4429-a636-0621c193cf21" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6b83a3f4-54bb-495a-80ae-a556533b80a6 tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Lock "cinder-quobyte-7502386e-07eb-4429-a636-0621c193cf21" acquired by "delete_volume" :: waited 0.026s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64f8428-5f80-43ca-8929-f99611b02185]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b83a3f4-54bb-495a-80ae-a556533b80a6 tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:40 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21 Jul 08 01:27:40 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:41 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56e1c3da-9e6e-42b6-91db-98c1b8de0308 1073741824" returned: 0 in 1.012s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56e1c3da-9e6e-42b6-91db-98c1b8de0308 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:41 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56e1c3da-9e6e-42b6-91db-98c1b8de0308 Jul 08 01:27:41 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:41 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b83a3f4-54bb-495a-80ae-a556533b80a6 tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21" returned: 0 in 0.803s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b83a3f4-54bb-495a-80ae-a556533b80a6 tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:41 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21 Jul 08 01:27:41 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:42 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56e1c3da-9e6e-42b6-91db-98c1b8de0308" returned: 0 in 0.730s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:42 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:27:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b385195a-221b-4c3f-886f-97a123c673e3 tempest-CinderUnicodeTest-1134404644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.192s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:42 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-b385195a-221b-4c3f-886f-97a123c673e3 tempest-CinderUnicodeTest-1134404644 None] Creating offline snapshot e1800233-bf3a-4615-b888-5f66c6bf44e9 of volume f899eee5-8e53-40cd-a37d-cadf20aa30e8 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:27:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb95178-6ce4-45d0-916d-1d11d8fe9ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56e1c3da-9e6e-42b6-91db-98c1b8de0308', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2bed9c1-9d19-4d36-9a60-5cd6fb71b27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:42 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[544cf3a1-bc84-4cc2-a2b1-575dfb5935dd]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b385195a-221b-4c3f-886f-97a123c673e3 tempest-CinderUnicodeTest-1134404644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:42 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Volume volume-56e1c3da-9e6e-42b6-91db-98c1b8de0308 (56e1c3da-9e6e-42b6-91db-98c1b8de0308): created successfully Jul 08 01:27:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2bed9c1-9d19-4d36-9a60-5cd6fb71b27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:42 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Flow 'volume_create_manager' (6c271e1e-30f8-4c8c-b5f0-39ed1061b30e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:42 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-9e59dba8-e2f0-4f75-a614-6915c02acbb9 tempest-CreateVolumesFromSnapshotTest-414282402 None] Created volume successfully. Jul 08 01:27:42 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8 Jul 08 01:27:42 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:42 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b83a3f4-54bb-495a-80ae-a556533b80a6 tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21" returned: 1 in 0.865s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b83a3f4-54bb-495a-80ae-a556533b80a6 tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:27:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b83a3f4-54bb-495a-80ae-a556533b80a6 tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:42 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21 Jul 08 01:27:42 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:42 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b385195a-221b-4c3f-886f-97a123c673e3 tempest-CinderUnicodeTest-1134404644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8" returned: 0 in 0.898s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b385195a-221b-4c3f-886f-97a123c673e3 tempest-CinderUnicodeTest-1134404644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8.e1800233-bf3a-4615-b888-5f66c6bf44e9 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:43 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8.e1800233-bf3a-4615-b888-5f66c6bf44e9 1G Jul 08 01:27:43 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:43 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7d1c95d7-ffc3-4839-b8a1-1883ab8ea143 tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "cinder-56e1c3da-9e6e-42b6-91db-98c1b8de0308-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:43 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7d1c95d7-ffc3-4839-b8a1-1883ab8ea143 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-56e1c3da-9e6e-42b6-91db-98c1b8de0308-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:43 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7d1c95d7-ffc3-4839-b8a1-1883ab8ea143 tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "cinder-quobyte-56e1c3da-9e6e-42b6-91db-98c1b8de0308" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:43 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7d1c95d7-ffc3-4839-b8a1-1883ab8ea143 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-quobyte-56e1c3da-9e6e-42b6-91db-98c1b8de0308" acquired by "delete_volume" :: waited 0.024s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:43 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa6c0f2-570c-4507-a073-abd71d527952]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7d1c95d7-ffc3-4839-b8a1-1883ab8ea143 tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56e1c3da-9e6e-42b6-91db-98c1b8de0308 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:43 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b83a3f4-54bb-495a-80ae-a556533b80a6 tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7502386e-07eb-4429-a636-0621c193cf21" returned: 0 in 0.784s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:43 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6b83a3f4-54bb-495a-80ae-a556533b80a6 tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Lock "cinder-quobyte-7502386e-07eb-4429-a636-0621c193cf21" released by "delete_volume" :: held 2.565s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:43 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56e1c3da-9e6e-42b6-91db-98c1b8de0308 Jul 08 01:27:43 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:43 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-6b83a3f4-54bb-495a-80ae-a556533b80a6 tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Created reservations ['1f29706d-2723-4ead-905d-ce16abc07364', 'bfbcf5f2-0af0-4747-bcbc-263ea3c7cffa', '17e1272b-0e7d-4152-80a8-f80c6ff2bc40', '17083930-d567-4e29-a02e-82af37c9e0f3'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6b83a3f4-54bb-495a-80ae-a556533b80a6 tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6b83a3f4-54bb-495a-80ae-a556533b80a6 tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:43 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-6b83a3f4-54bb-495a-80ae-a556533b80a6 tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:43 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-6b83a3f4-54bb-495a-80ae-a556533b80a6 tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6b83a3f4-54bb-495a-80ae-a556533b80a6 tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b83a3f4-54bb-495a-80ae-a556533b80a6 tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:43 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:27:43 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:44 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b385195a-221b-4c3f-886f-97a123c673e3 tempest-CinderUnicodeTest-1134404644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8.e1800233-bf3a-4615-b888-5f66c6bf44e9 1G" returned: 0 in 1.089s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b385195a-221b-4c3f-886f-97a123c673e3 tempest-CinderUnicodeTest-1134404644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8.e1800233-bf3a-4615-b888-5f66c6bf44e9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:44 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7d1c95d7-ffc3-4839-b8a1-1883ab8ea143 tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56e1c3da-9e6e-42b6-91db-98c1b8de0308" returned: 0 in 0.934s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7d1c95d7-ffc3-4839-b8a1-1883ab8ea143 tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56e1c3da-9e6e-42b6-91db-98c1b8de0308 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:44 devstack sudo[104938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8.e1800233-bf3a-4615-b888-5f66c6bf44e9 Jul 08 01:27:44 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:44 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56e1c3da-9e6e-42b6-91db-98c1b8de0308 Jul 08 01:27:44 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:44 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b83a3f4-54bb-495a-80ae-a556533b80a6 tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.905s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:44 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-6b83a3f4-54bb-495a-80ae-a556533b80a6 tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:27:44 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-6b83a3f4-54bb-495a-80ae-a556533b80a6 tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Deleted volume successfully. Jul 08 01:27:44 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6b83a3f4-54bb-495a-80ae-a556533b80a6 tempest-VolumeAndVolumeTypeFromImageTest-1745592606 None] Lock "cinder-7502386e-07eb-4429-a636-0621c193cf21-delete_volume" released by "delete_volume" :: held 3.988s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:45 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7d1c95d7-ffc3-4839-b8a1-1883ab8ea143 tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-56e1c3da-9e6e-42b6-91db-98c1b8de0308" returned: 0 in 0.890s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:45 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7d1c95d7-ffc3-4839-b8a1-1883ab8ea143 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-quobyte-56e1c3da-9e6e-42b6-91db-98c1b8de0308" released by "delete_volume" :: held 1.881s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:45 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b385195a-221b-4c3f-886f-97a123c673e3 tempest-CinderUnicodeTest-1134404644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8.e1800233-bf3a-4615-b888-5f66c6bf44e9" returned: 0 in 1.017s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:45 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-b385195a-221b-4c3f-886f-97a123c673e3 tempest-CinderUnicodeTest-1134404644 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8.e1800233-bf3a-4615-b888-5f66c6bf44e9 is being set with open permissions: ugo+rw Jul 08 01:27:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b385195a-221b-4c3f-886f-97a123c673e3 tempest-CinderUnicodeTest-1134404644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8.e1800233-bf3a-4615-b888-5f66c6bf44e9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:45 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-7d1c95d7-ffc3-4839-b8a1-1883ab8ea143 tempest-CreateVolumesFromSnapshotTest-414282402 None] Created reservations ['8a31e7ba-a02d-463c-bc0a-e053dc0667eb', 'db07451a-8a70-4d8a-85bc-bebd15857c8d', '2d448a27-b360-47ad-a0a4-c1d722c1ae1b', '5f40fabc-d9ae-4f89-9b6e-844935da5122'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:45 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8.e1800233-bf3a-4615-b888-5f66c6bf44e9 Jul 08 01:27:45 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7d1c95d7-ffc3-4839-b8a1-1883ab8ea143 tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7d1c95d7-ffc3-4839-b8a1-1883ab8ea143 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7d1c95d7-ffc3-4839-b8a1-1883ab8ea143 tempest-CreateVolumesFromSnapshotTest-414282402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7d1c95d7-ffc3-4839-b8a1-1883ab8ea143 tempest-CreateVolumesFromSnapshotTest-414282402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7d1c95d7-ffc3-4839-b8a1-1883ab8ea143 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7d1c95d7-ffc3-4839-b8a1-1883ab8ea143 tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:45 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:27:45 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:45 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:27:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:45 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0c1bda9c-3691-4b7f-8cc0-99341fda69ff tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "cinder-c07248f0-6b1c-4aa9-9206-f3e89dfce405-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:45 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:27:45 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:45 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0c1bda9c-3691-4b7f-8cc0-99341fda69ff tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-c07248f0-6b1c-4aa9-9206-f3e89dfce405-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:45 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0c1bda9c-3691-4b7f-8cc0-99341fda69ff tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "cinder-quobyte-c07248f0-6b1c-4aa9-9206-f3e89dfce405" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:45 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0c1bda9c-3691-4b7f-8cc0-99341fda69ff tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-quobyte-c07248f0-6b1c-4aa9-9206-f3e89dfce405" acquired by "delete_volume" :: waited 0.023s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:45 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[0989a000-420a-4dec-90fb-4257fe69e518]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0c1bda9c-3691-4b7f-8cc0-99341fda69ff tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c07248f0-6b1c-4aa9-9206-f3e89dfce405 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:45 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c07248f0-6b1c-4aa9-9206-f3e89dfce405 Jul 08 01:27:45 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:46 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b385195a-221b-4c3f-886f-97a123c673e3 tempest-CinderUnicodeTest-1134404644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8.e1800233-bf3a-4615-b888-5f66c6bf44e9" returned: 0 in 1.006s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b385195a-221b-4c3f-886f-97a123c673e3 tempest-CinderUnicodeTest-1134404644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:46 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8.info Jul 08 01:27:46 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:46 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7d1c95d7-ffc3-4839-b8a1-1883ab8ea143 tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.250s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:46 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-7d1c95d7-ffc3-4839-b8a1-1883ab8ea143 tempest-CreateVolumesFromSnapshotTest-414282402 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:27:46 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-7d1c95d7-ffc3-4839-b8a1-1883ab8ea143 tempest-CreateVolumesFromSnapshotTest-414282402 None] Deleted volume successfully. Jul 08 01:27:46 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7d1c95d7-ffc3-4839-b8a1-1883ab8ea143 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-56e1c3da-9e6e-42b6-91db-98c1b8de0308-delete_volume" released by "delete_volume" :: held 3.506s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:46 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.281s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:46 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:27:46 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:27:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread count: 28 {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:27:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread info: [<_MainThread(MainThread, started 134382216167552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:27:46 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0c1bda9c-3691-4b7f-8cc0-99341fda69ff tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c07248f0-6b1c-4aa9-9206-f3e89dfce405" returned: 0 in 1.313s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0c1bda9c-3691-4b7f-8cc0-99341fda69ff tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c07248f0-6b1c-4aa9-9206-f3e89dfce405 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:46 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c07248f0-6b1c-4aa9-9206-f3e89dfce405 Jul 08 01:27:46 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:47 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b385195a-221b-4c3f-886f-97a123c673e3 tempest-CinderUnicodeTest-1134404644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8.info" returned: 0 in 0.815s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:47 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-b385195a-221b-4c3f-886f-97a123c673e3 tempest-CinderUnicodeTest-1134404644 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8.info is being set with open permissions: ugo+rw Jul 08 01:27:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b385195a-221b-4c3f-886f-97a123c673e3 tempest-CinderUnicodeTest-1134404644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:47 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8.info Jul 08 01:27:47 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:47 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0c1bda9c-3691-4b7f-8cc0-99341fda69ff tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c07248f0-6b1c-4aa9-9206-f3e89dfce405" returned: 0 in 0.879s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:47 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0c1bda9c-3691-4b7f-8cc0-99341fda69ff tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-quobyte-c07248f0-6b1c-4aa9-9206-f3e89dfce405" released by "delete_volume" :: held 2.282s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:47 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b385195a-221b-4c3f-886f-97a123c673e3 tempest-CinderUnicodeTest-1134404644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8.info" returned: 0 in 0.922s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b385195a-221b-4c3f-886f-97a123c673e3 tempest-CinderUnicodeTest-1134404644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.906s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:47 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-b385195a-221b-4c3f-886f-97a123c673e3 tempest-CinderUnicodeTest-1134404644 None] Create snapshot completed successfully Jul 08 01:27:48 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-0c1bda9c-3691-4b7f-8cc0-99341fda69ff tempest-CreateVolumesFromSnapshotTest-414282402 None] Created reservations ['7e386757-e22c-41dd-90a8-f9c80fb7f035', 'a5479453-d5fd-4e84-823f-bd77737c7203', 'ac44c369-152e-45ad-b0d3-e841318c4da9', 'e70a3909-cab5-494b-aea1-27e38ea78792'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-0c1bda9c-3691-4b7f-8cc0-99341fda69ff tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-0c1bda9c-3691-4b7f-8cc0-99341fda69ff tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:48 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-0c1bda9c-3691-4b7f-8cc0-99341fda69ff tempest-CreateVolumesFromSnapshotTest-414282402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:48 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-0c1bda9c-3691-4b7f-8cc0-99341fda69ff tempest-CreateVolumesFromSnapshotTest-414282402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-0c1bda9c-3691-4b7f-8cc0-99341fda69ff tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0c1bda9c-3691-4b7f-8cc0-99341fda69ff tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:48 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:27:48 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:48 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e734dca9-0ed8-4244-95ec-14525a52c212 tempest-CinderUnicodeTest-1134404644 None] Acquiring lock "cinder-e1800233-bf3a-4615-b888-5f66c6bf44e9-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:48 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e734dca9-0ed8-4244-95ec-14525a52c212 tempest-CinderUnicodeTest-1134404644 None] Lock "cinder-e1800233-bf3a-4615-b888-5f66c6bf44e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:48 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:48 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e734dca9-0ed8-4244-95ec-14525a52c212 tempest-CinderUnicodeTest-1134404644 None] Acquiring lock "cinder-quobyte-f899eee5-8e53-40cd-a37d-cadf20aa30e8" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0c1bda9c-3691-4b7f-8cc0-99341fda69ff tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.770s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:48 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-0c1bda9c-3691-4b7f-8cc0-99341fda69ff tempest-CreateVolumesFromSnapshotTest-414282402 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:27:48 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-0c1bda9c-3691-4b7f-8cc0-99341fda69ff tempest-CreateVolumesFromSnapshotTest-414282402 None] Deleted volume successfully. Jul 08 01:27:48 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e734dca9-0ed8-4244-95ec-14525a52c212 tempest-CinderUnicodeTest-1134404644 None] Lock "cinder-quobyte-f899eee5-8e53-40cd-a37d-cadf20aa30e8" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:48 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e734dca9-0ed8-4244-95ec-14525a52c212 tempest-CinderUnicodeTest-1134404644 None] Acquiring lock "cinder-quobyte-e1800233-bf3a-4615-b888-5f66c6bf44e9" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:48 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e734dca9-0ed8-4244-95ec-14525a52c212 tempest-CinderUnicodeTest-1134404644 None] Lock "cinder-quobyte-e1800233-bf3a-4615-b888-5f66c6bf44e9" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:48 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-e734dca9-0ed8-4244-95ec-14525a52c212 tempest-CinderUnicodeTest-1134404644 None] Deleting offline snapshot e1800233-bf3a-4615-b888-5f66c6bf44e9 of volume f899eee5-8e53-40cd-a37d-cadf20aa30e8 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:27:48 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-e734dca9-0ed8-4244-95ec-14525a52c212 tempest-CinderUnicodeTest-1134404644 None] snapshot_file for this snap is: volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8.e1800233-bf3a-4615-b888-5f66c6bf44e9 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:27:48 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0c1bda9c-3691-4b7f-8cc0-99341fda69ff tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-c07248f0-6b1c-4aa9-9206-f3e89dfce405-delete_volume" released by "delete_volume" :: held 3.438s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:48 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2b6aa6-7738-46e2-a5a1-188381fab86a]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e734dca9-0ed8-4244-95ec-14525a52c212 tempest-CinderUnicodeTest-1134404644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8.e1800233-bf3a-4615-b888-5f66c6bf44e9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:48 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-be527cb4-bdea-4634-9236-913933846c09 tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "cinder-895315d7-f9ab-44f4-bed2-4c281a62d5a0-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:49 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-be527cb4-bdea-4634-9236-913933846c09 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-895315d7-f9ab-44f4-bed2-4c281a62d5a0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:49 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-be527cb4-bdea-4634-9236-913933846c09 tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "cinder-quobyte-895315d7-f9ab-44f4-bed2-4c281a62d5a0" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:49 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8.e1800233-bf3a-4615-b888-5f66c6bf44e9 Jul 08 01:27:49 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:49 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-be527cb4-bdea-4634-9236-913933846c09 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-quobyte-895315d7-f9ab-44f4-bed2-4c281a62d5a0" acquired by "delete_volume" :: waited 0.030s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:49 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb59064-600a-45f5-8f55-e00e68e2b9eb]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-be527cb4-bdea-4634-9236-913933846c09 tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-895315d7-f9ab-44f4-bed2-4c281a62d5a0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:49 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-895315d7-f9ab-44f4-bed2-4c281a62d5a0 Jul 08 01:27:49 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:49 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e734dca9-0ed8-4244-95ec-14525a52c212 tempest-CinderUnicodeTest-1134404644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8.e1800233-bf3a-4615-b888-5f66c6bf44e9" returned: 0 in 1.003s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:49 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-e734dca9-0ed8-4244-95ec-14525a52c212 tempest-CinderUnicodeTest-1134404644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:27:50 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7688b5ed-a347-4dfd-9393-47df8a57adfd]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e734dca9-0ed8-4244-95ec-14525a52c212 tempest-CinderUnicodeTest-1134404644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:50 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:27:50 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8 Jul 08 01:27:50 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:50 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:50 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Flow 'volume_create_manager' (b8f480da-1aff-4667-8f14-b650c731c174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:50 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ea4cd5-e161-4d90-b8fa-e3b153030a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-be527cb4-bdea-4634-9236-913933846c09 tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-895315d7-f9ab-44f4-bed2-4c281a62d5a0" returned: 0 in 1.039s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-be527cb4-bdea-4634-9236-913933846c09 tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-895315d7-f9ab-44f4-bed2-4c281a62d5a0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:50 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ea4cd5-e161-4d90-b8fa-e3b153030a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-282031680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67740ab5-2dda-497c-ba11-53ac1516e06a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2339b16c7ebc43a990543c9cca410e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:50Z,use_quota=True,user_id='17c531f647404919acc3c762da37c59c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:50 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-895315d7-f9ab-44f4-bed2-4c281a62d5a0 Jul 08 01:27:50 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:50 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (334a0607-0a5f-40af-b121-04951d6d867c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:50 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (334a0607-0a5f-40af-b121-04951d6d867c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:50 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9016ddea-5dd5-4a6e-bde6-2b9b32ccb12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:50 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9016ddea-5dd5-4a6e-bde6-2b9b32ccb12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67740ab5-2dda-497c-ba11-53ac1516e06a', 'volume_name': 'volume-67740ab5-2dda-497c-ba11-53ac1516e06a', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:50 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18f01c7b-bd00-4335-b49f-78ce9ec68dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:50 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18f01c7b-bd00-4335-b49f-78ce9ec68dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:50 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa6b9aa-1f4f-4658-8b54-3b3bfa383eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:50 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Volume 67740ab5-2dda-497c-ba11-53ac1516e06a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67740ab5-2dda-497c-ba11-53ac1516e06a', 'volume_size': 1} Jul 08 01:27:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:50 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-282031680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67740ab5-2dda-497c-ba11-53ac1516e06a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2339b16c7ebc43a990543c9cca410e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:50Z,use_quota=True,user_id='17c531f647404919acc3c762da37c59c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:27:50 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Creating volume 67740ab5-2dda-497c-ba11-53ac1516e06a {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:27:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:50 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:50 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:50 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:27:50 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:27:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:50 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a 1073741824 Jul 08 01:27:50 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:50 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-be527cb4-bdea-4634-9236-913933846c09 tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-895315d7-f9ab-44f4-bed2-4c281a62d5a0" returned: 0 in 0.750s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-be527cb4-bdea-4634-9236-913933846c09 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-quobyte-895315d7-f9ab-44f4-bed2-4c281a62d5a0" released by "delete_volume" :: held 1.862s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:51 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e734dca9-0ed8-4244-95ec-14525a52c212 tempest-CinderUnicodeTest-1134404644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8" returned: 0 in 1.004s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e734dca9-0ed8-4244-95ec-14525a52c212 tempest-CinderUnicodeTest-1134404644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8.e1800233-bf3a-4615-b888-5f66c6bf44e9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:51 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8.e1800233-bf3a-4615-b888-5f66c6bf44e9 Jul 08 01:27:51 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:51 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-be527cb4-bdea-4634-9236-913933846c09 tempest-CreateVolumesFromSnapshotTest-414282402 None] Created reservations ['8d410dc0-ce40-4619-ad94-2bd6289082b5', '885cbafe-8ae5-4257-8021-84f601154f48', 'ad170fbe-3a0d-4b7f-802b-ba5aef6b2f32', '5b185515-acbf-4ca8-9252-1ce8863c530a'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-be527cb4-bdea-4634-9236-913933846c09 tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-be527cb4-bdea-4634-9236-913933846c09 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:51 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-be527cb4-bdea-4634-9236-913933846c09 tempest-CreateVolumesFromSnapshotTest-414282402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:51 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-be527cb4-bdea-4634-9236-913933846c09 tempest-CreateVolumesFromSnapshotTest-414282402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-be527cb4-bdea-4634-9236-913933846c09 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-be527cb4-bdea-4634-9236-913933846c09 tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:51 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:27:51 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:51 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1659c761-4448-4f24-81d5-680148ba3b97 tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "cinder-a98727bc-e799-4985-8083-cdf7b24b611f-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:51 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1659c761-4448-4f24-81d5-680148ba3b97 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-a98727bc-e799-4985-8083-cdf7b24b611f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:51 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a 1073741824" returned: 0 in 1.165s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:51 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1659c761-4448-4f24-81d5-680148ba3b97 tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "cinder-quobyte-a98727bc-e799-4985-8083-cdf7b24b611f" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:51 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1659c761-4448-4f24-81d5-680148ba3b97 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-quobyte-a98727bc-e799-4985-8083-cdf7b24b611f" acquired by "delete_volume" :: waited 0.029s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:51 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a Jul 08 01:27:51 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:51 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1590c87-5907-4ca7-ba2c-e54900ea1990]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1659c761-4448-4f24-81d5-680148ba3b97 tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a98727bc-e799-4985-8083-cdf7b24b611f {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:51 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a98727bc-e799-4985-8083-cdf7b24b611f Jul 08 01:27:51 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:52 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-be527cb4-bdea-4634-9236-913933846c09 tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.904s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:52 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-be527cb4-bdea-4634-9236-913933846c09 tempest-CreateVolumesFromSnapshotTest-414282402 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:27:52 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-be527cb4-bdea-4634-9236-913933846c09 tempest-CreateVolumesFromSnapshotTest-414282402 None] Deleted volume successfully. Jul 08 01:27:52 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-be527cb4-bdea-4634-9236-913933846c09 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-895315d7-f9ab-44f4-bed2-4c281a62d5a0-delete_volume" released by "delete_volume" :: held 3.124s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:52 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e734dca9-0ed8-4244-95ec-14525a52c212 tempest-CinderUnicodeTest-1134404644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8.e1800233-bf3a-4615-b888-5f66c6bf44e9" returned: 0 in 1.199s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e734dca9-0ed8-4244-95ec-14525a52c212 tempest-CinderUnicodeTest-1134404644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8.e1800233-bf3a-4615-b888-5f66c6bf44e9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:52 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8.e1800233-bf3a-4615-b888-5f66c6bf44e9 Jul 08 01:27:52 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:52 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a" returned: 0 in 1.018s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] <== create_volume: return (2273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:27:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.280s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa6b9aa-1f4f-4658-8b54-3b3bfa383eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67740ab5-2dda-497c-ba11-53ac1516e06a', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:52 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbbd5546-24c8-47b4-8d7c-b85c885b555b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1659c761-4448-4f24-81d5-680148ba3b97 tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a98727bc-e799-4985-8083-cdf7b24b611f" returned: 0 in 1.009s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1659c761-4448-4f24-81d5-680148ba3b97 tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a98727bc-e799-4985-8083-cdf7b24b611f {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:52 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Volume volume-67740ab5-2dda-497c-ba11-53ac1516e06a (67740ab5-2dda-497c-ba11-53ac1516e06a): created successfully Jul 08 01:27:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbbd5546-24c8-47b4-8d7c-b85c885b555b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:52 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a98727bc-e799-4985-8083-cdf7b24b611f Jul 08 01:27:52 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:52 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Flow 'volume_create_manager' (b8f480da-1aff-4667-8f14-b650c731c174) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:52 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-d82b17de-2c1e-4ec3-aaec-81a57778078b tempest-VolumeDependencyTests-1880504022 None] Created volume successfully. Jul 08 01:27:53 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e734dca9-0ed8-4244-95ec-14525a52c212 tempest-CinderUnicodeTest-1134404644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8.e1800233-bf3a-4615-b888-5f66c6bf44e9" returned: 0 in 0.802s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:53 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e734dca9-0ed8-4244-95ec-14525a52c212 tempest-CinderUnicodeTest-1134404644 None] Lock "cinder-quobyte-e1800233-bf3a-4615-b888-5f66c6bf44e9" released by "_delete_snapshot" :: held 4.158s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:53 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e734dca9-0ed8-4244-95ec-14525a52c212 tempest-CinderUnicodeTest-1134404644 None] Lock "cinder-quobyte-f899eee5-8e53-40cd-a37d-cadf20aa30e8" released by "delete_snapshot" :: held 4.199s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:53 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-e734dca9-0ed8-4244-95ec-14525a52c212 tempest-CinderUnicodeTest-1134404644 None] Created reservations ['69e42acf-0c1b-49db-b042-12c1bdde4bdd', '42241b8f-02f4-4d98-9719-f6b6de823920', '30b85ac1-3bbb-40fe-847c-8b3fb44826b2', '46b1f0b5-ed15-4e39-b6e5-f82a2b380f88'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:53 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-e734dca9-0ed8-4244-95ec-14525a52c212 tempest-CinderUnicodeTest-1134404644 None] Delete snapshot completed successfully. Jul 08 01:27:53 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e734dca9-0ed8-4244-95ec-14525a52c212 tempest-CinderUnicodeTest-1134404644 None] Lock "cinder-e1800233-bf3a-4615-b888-5f66c6bf44e9-delete_snapshot" released by "delete_snapshot" :: held 4.372s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:53 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1659c761-4448-4f24-81d5-680148ba3b97 tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a98727bc-e799-4985-8083-cdf7b24b611f" returned: 0 in 0.719s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:53 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1659c761-4448-4f24-81d5-680148ba3b97 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-quobyte-a98727bc-e799-4985-8083-cdf7b24b611f" released by "delete_volume" :: held 1.788s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:53 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-1659c761-4448-4f24-81d5-680148ba3b97 tempest-CreateVolumesFromSnapshotTest-414282402 None] Created reservations ['40083bf7-5999-467f-a048-f349c011d221', '4bff325a-ef31-41c5-ace5-acf979f5beef', 'edacb011-2546-44db-b4ea-41fcfeb1ea33', 'ba038ecd-f7f5-4859-b81b-1aba8a33b649'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1659c761-4448-4f24-81d5-680148ba3b97 tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1659c761-4448-4f24-81d5-680148ba3b97 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:53 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1659c761-4448-4f24-81d5-680148ba3b97 tempest-CreateVolumesFromSnapshotTest-414282402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:53 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1659c761-4448-4f24-81d5-680148ba3b97 tempest-CreateVolumesFromSnapshotTest-414282402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1659c761-4448-4f24-81d5-680148ba3b97 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1659c761-4448-4f24-81d5-680148ba3b97 tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:53 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:27:53 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b5d79d43-1b8e-4c60-82ea-0bca58b05877 tempest-VolumeDependencyTests-1880504022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b5d79d43-1b8e-4c60-82ea-0bca58b05877 tempest-VolumeDependencyTests-1880504022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:53 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-b5d79d43-1b8e-4c60-82ea-0bca58b05877 tempest-VolumeDependencyTests-1880504022 None] Creating offline snapshot c457a3ce-c8a3-443a-9616-a73011a10d1b of volume 67740ab5-2dda-497c-ba11-53ac1516e06a {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:27:53 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91aabe8-4f7a-4e34-a155-dbe762c5e886]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b5d79d43-1b8e-4c60-82ea-0bca58b05877 tempest-VolumeDependencyTests-1880504022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:53 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-272f414c-04e1-4851-864c-e3c9582a41ac tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "cinder-c529778b-4856-4d9a-94de-f9479b19ea8b-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:53 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-272f414c-04e1-4851-864c-e3c9582a41ac tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-c529778b-4856-4d9a-94de-f9479b19ea8b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:53 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a Jul 08 01:27:53 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:53 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-272f414c-04e1-4851-864c-e3c9582a41ac tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "cinder-quobyte-c529778b-4856-4d9a-94de-f9479b19ea8b" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:53 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-272f414c-04e1-4851-864c-e3c9582a41ac tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-quobyte-c529778b-4856-4d9a-94de-f9479b19ea8b" acquired by "delete_volume" :: waited 0.017s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:53 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa4456d-5237-4ec4-9906-4331d55d9710]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-272f414c-04e1-4851-864c-e3c9582a41ac tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c529778b-4856-4d9a-94de-f9479b19ea8b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:54 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c529778b-4856-4d9a-94de-f9479b19ea8b Jul 08 01:27:54 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:54 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ab1bca52-ae68-4e38-a440-443b61ad6979 tempest-CinderUnicodeTest-1134404644 None] Acquiring lock "cinder-f899eee5-8e53-40cd-a37d-cadf20aa30e8-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:54 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ab1bca52-ae68-4e38-a440-443b61ad6979 tempest-CinderUnicodeTest-1134404644 None] Lock "cinder-f899eee5-8e53-40cd-a37d-cadf20aa30e8-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:54 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1659c761-4448-4f24-81d5-680148ba3b97 tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.788s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:54 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-1659c761-4448-4f24-81d5-680148ba3b97 tempest-CreateVolumesFromSnapshotTest-414282402 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:27:54 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-1659c761-4448-4f24-81d5-680148ba3b97 tempest-CreateVolumesFromSnapshotTest-414282402 None] Deleted volume successfully. Jul 08 01:27:54 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ab1bca52-ae68-4e38-a440-443b61ad6979 tempest-CinderUnicodeTest-1134404644 None] Acquiring lock "cinder-quobyte-f899eee5-8e53-40cd-a37d-cadf20aa30e8" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:54 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1659c761-4448-4f24-81d5-680148ba3b97 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-a98727bc-e799-4985-8083-cdf7b24b611f-delete_volume" released by "delete_volume" :: held 2.994s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:54 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ab1bca52-ae68-4e38-a440-443b61ad6979 tempest-CinderUnicodeTest-1134404644 None] Lock "cinder-quobyte-f899eee5-8e53-40cd-a37d-cadf20aa30e8" acquired by "delete_volume" :: waited 0.028s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:54 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72d4fd7-1b0b-4061-98d8-a589f52487e4]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ab1bca52-ae68-4e38-a440-443b61ad6979 tempest-CinderUnicodeTest-1134404644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:54 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8 Jul 08 01:27:54 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:54 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b5d79d43-1b8e-4c60-82ea-0bca58b05877 tempest-VolumeDependencyTests-1880504022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a" returned: 0 in 1.209s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b5d79d43-1b8e-4c60-82ea-0bca58b05877 tempest-VolumeDependencyTests-1880504022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a.c457a3ce-c8a3-443a-9616-a73011a10d1b 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:54 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a.c457a3ce-c8a3-443a-9616-a73011a10d1b 1G Jul 08 01:27:54 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:55 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-272f414c-04e1-4851-864c-e3c9582a41ac tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c529778b-4856-4d9a-94de-f9479b19ea8b" returned: 0 in 1.106s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-272f414c-04e1-4851-864c-e3c9582a41ac tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c529778b-4856-4d9a-94de-f9479b19ea8b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:55 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c529778b-4856-4d9a-94de-f9479b19ea8b Jul 08 01:27:55 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:55 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:27:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Flow 'volume_create_manager' (0db39310-28ab-4eb7-b968-94a79e524080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6406c3f6-06b7-4805-b80f-c6836839022c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6406c3f6-06b7-4805-b80f-c6836839022c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-641159703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb91f621-6665-45e7-860c-ac0c1df0c81c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7fee074c694d51b8bc0f7e906a5c15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:55Z,use_quota=True,user_id='e9d9d382133d4aa59333317799ac586a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3103f37c-8c54-4c5d-90ca-67f9b6d38478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3103f37c-8c54-4c5d-90ca-67f9b6d38478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbbf730a-d13c-44fd-b506-8877aa8e41a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbbf730a-d13c-44fd-b506-8877aa8e41a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb91f621-6665-45e7-860c-ac0c1df0c81c', 'volume_name': 'volume-bb91f621-6665-45e7-860c-ac0c1df0c81c', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbaed076-26e4-47fe-9b13-d9fd1163fa66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbaed076-26e4-47fe-9b13-d9fd1163fa66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:55 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b524f63-cd73-4d54-803a-cb3e3deca634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:55 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Volume bb91f621-6665-45e7-860c-ac0c1df0c81c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb91f621-6665-45e7-860c-ac0c1df0c81c', 'volume_size': 1} Jul 08 01:27:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:55 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ab1bca52-ae68-4e38-a440-443b61ad6979 tempest-CinderUnicodeTest-1134404644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8" returned: 0 in 0.915s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ab1bca52-ae68-4e38-a440-443b61ad6979 tempest-CinderUnicodeTest-1134404644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:55 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8 Jul 08 01:27:55 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:55 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-272f414c-04e1-4851-864c-e3c9582a41ac tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-c529778b-4856-4d9a-94de-f9479b19ea8b" returned: 0 in 0.696s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:55 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-272f414c-04e1-4851-864c-e3c9582a41ac tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-quobyte-c529778b-4856-4d9a-94de-f9479b19ea8b" released by "delete_volume" :: held 1.877s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:55 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-272f414c-04e1-4851-864c-e3c9582a41ac tempest-CreateVolumesFromSnapshotTest-414282402 None] Created reservations ['6764e563-ebc0-4f54-b08b-ab43221a88bd', 'd9cbf6ed-4111-4515-bc6b-d0e92369ccb1', '3707cc1c-6237-4e2e-a2d3-1b063fc09461', '47da8a95-4d6a-4bdf-b6db-ba8ec9d1e39d'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:55 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b5d79d43-1b8e-4c60-82ea-0bca58b05877 tempest-VolumeDependencyTests-1880504022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a.c457a3ce-c8a3-443a-9616-a73011a10d1b 1G" returned: 0 in 1.060s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b5d79d43-1b8e-4c60-82ea-0bca58b05877 tempest-VolumeDependencyTests-1880504022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67740ab5-2dda-497c-ba11-53ac1516e06a -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a.c457a3ce-c8a3-443a-9616-a73011a10d1b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-272f414c-04e1-4851-864c-e3c9582a41ac tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-272f414c-04e1-4851-864c-e3c9582a41ac tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:55 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-272f414c-04e1-4851-864c-e3c9582a41ac tempest-CreateVolumesFromSnapshotTest-414282402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:55 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67740ab5-2dda-497c-ba11-53ac1516e06a -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a.c457a3ce-c8a3-443a-9616-a73011a10d1b Jul 08 01:27:55 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:55 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-272f414c-04e1-4851-864c-e3c9582a41ac tempest-CreateVolumesFromSnapshotTest-414282402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-272f414c-04e1-4851-864c-e3c9582a41ac tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-272f414c-04e1-4851-864c-e3c9582a41ac tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:55 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:27:55 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0e5aa34f-7442-4aa5-a7d5-fe21f2c3be6b tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "cinder-89da8d23-3c9c-484d-ac04-cd5b7dea4a82-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0e5aa34f-7442-4aa5-a7d5-fe21f2c3be6b tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-89da8d23-3c9c-484d-ac04-cd5b7dea4a82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0e5aa34f-7442-4aa5-a7d5-fe21f2c3be6b tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "cinder-quobyte-aec08254-83de-4049-8a62-4dba35bcaabd" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:56 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0e5aa34f-7442-4aa5-a7d5-fe21f2c3be6b tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-quobyte-aec08254-83de-4049-8a62-4dba35bcaabd" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0e5aa34f-7442-4aa5-a7d5-fe21f2c3be6b tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "cinder-quobyte-89da8d23-3c9c-484d-ac04-cd5b7dea4a82" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ab1bca52-ae68-4e38-a440-443b61ad6979 tempest-CinderUnicodeTest-1134404644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f899eee5-8e53-40cd-a37d-cadf20aa30e8" returned: 0 in 0.721s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0e5aa34f-7442-4aa5-a7d5-fe21f2c3be6b tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-quobyte-89da8d23-3c9c-484d-ac04-cd5b7dea4a82" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-0e5aa34f-7442-4aa5-a7d5-fe21f2c3be6b tempest-CreateVolumesFromSnapshotTest-414282402 None] Deleting offline snapshot 89da8d23-3c9c-484d-ac04-cd5b7dea4a82 of volume aec08254-83de-4049-8a62-4dba35bcaabd {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-0e5aa34f-7442-4aa5-a7d5-fe21f2c3be6b tempest-CreateVolumesFromSnapshotTest-414282402 None] snapshot_file for this snap is: volume-aec08254-83de-4049-8a62-4dba35bcaabd.89da8d23-3c9c-484d-ac04-cd5b7dea4a82 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ab1bca52-ae68-4e38-a440-443b61ad6979 tempest-CinderUnicodeTest-1134404644 None] Lock "cinder-quobyte-f899eee5-8e53-40cd-a37d-cadf20aa30e8" released by "delete_volume" :: held 1.768s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a97f74-ee17-49b6-a585-614d26a9af57]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0e5aa34f-7442-4aa5-a7d5-fe21f2c3be6b tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd.89da8d23-3c9c-484d-ac04-cd5b7dea4a82 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-ab1bca52-ae68-4e38-a440-443b61ad6979 tempest-CinderUnicodeTest-1134404644 None] Created reservations ['ee7633c1-5b31-43dd-8df8-49bd2bef8d8d', '4f862055-f781-4fc3-af9b-a166f0297f73', '8f86aec7-67d2-4899-a3b4-df9b0ce67e98', '5b1adcd9-5292-43bb-ac72-5127e0c4d0c0'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:56 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd.89da8d23-3c9c-484d-ac04-cd5b7dea4a82 Jul 08 01:27:56 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ab1bca52-ae68-4e38-a440-443b61ad6979 tempest-CinderUnicodeTest-1134404644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ab1bca52-ae68-4e38-a440-443b61ad6979 tempest-CinderUnicodeTest-1134404644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ab1bca52-ae68-4e38-a440-443b61ad6979 tempest-CinderUnicodeTest-1134404644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ab1bca52-ae68-4e38-a440-443b61ad6979 tempest-CinderUnicodeTest-1134404644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ab1bca52-ae68-4e38-a440-443b61ad6979 tempest-CinderUnicodeTest-1134404644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ab1bca52-ae68-4e38-a440-443b61ad6979 tempest-CinderUnicodeTest-1134404644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:56 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:27:56 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-32f4fa69-fb62-4900-b23b-9a5b47c1943b tempest-CinderUnicodeTest-1134404644 None] Acquiring lock "cinder-e71f11f4-31d3-4328-a366-b586cc54ca3c-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-32f4fa69-fb62-4900-b23b-9a5b47c1943b tempest-CinderUnicodeTest-1134404644 None] Lock "cinder-e71f11f4-31d3-4328-a366-b586cc54ca3c-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-32f4fa69-fb62-4900-b23b-9a5b47c1943b tempest-CinderUnicodeTest-1134404644 None] Acquiring lock "cinder-quobyte-e71f11f4-31d3-4328-a366-b586cc54ca3c" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-32f4fa69-fb62-4900-b23b-9a5b47c1943b tempest-CinderUnicodeTest-1134404644 None] Lock "cinder-quobyte-e71f11f4-31d3-4328-a366-b586cc54ca3c" acquired by "delete_volume" :: waited 0.035s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[637211cd-e3eb-4e6e-841e-c11e0eadc7e4]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-32f4fa69-fb62-4900-b23b-9a5b47c1943b tempest-CinderUnicodeTest-1134404644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e71f11f4-31d3-4328-a366-b586cc54ca3c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:56 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-272f414c-04e1-4851-864c-e3c9582a41ac tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.950s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-272f414c-04e1-4851-864c-e3c9582a41ac tempest-CreateVolumesFromSnapshotTest-414282402 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:27:56 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-272f414c-04e1-4851-864c-e3c9582a41ac tempest-CreateVolumesFromSnapshotTest-414282402 None] Deleted volume successfully. Jul 08 01:27:56 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b5d79d43-1b8e-4c60-82ea-0bca58b05877 tempest-VolumeDependencyTests-1880504022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67740ab5-2dda-497c-ba11-53ac1516e06a -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a.c457a3ce-c8a3-443a-9616-a73011a10d1b" returned: 0 in 1.059s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:56 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-b5d79d43-1b8e-4c60-82ea-0bca58b05877 tempest-VolumeDependencyTests-1880504022 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a.c457a3ce-c8a3-443a-9616-a73011a10d1b is being set with open permissions: ugo+rw Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b5d79d43-1b8e-4c60-82ea-0bca58b05877 tempest-VolumeDependencyTests-1880504022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a.c457a3ce-c8a3-443a-9616-a73011a10d1b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:56 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e71f11f4-31d3-4328-a366-b586cc54ca3c Jul 08 01:27:56 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-272f414c-04e1-4851-864c-e3c9582a41ac tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-c529778b-4856-4d9a-94de-f9479b19ea8b-delete_volume" released by "delete_volume" :: held 3.202s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:56 devstack sudo[105065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a.c457a3ce-c8a3-443a-9616-a73011a10d1b Jul 08 01:27:56 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:57 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0e5aa34f-7442-4aa5-a7d5-fe21f2c3be6b tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd.89da8d23-3c9c-484d-ac04-cd5b7dea4a82" returned: 0 in 1.062s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:57 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-0e5aa34f-7442-4aa5-a7d5-fe21f2c3be6b tempest-CreateVolumesFromSnapshotTest-414282402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aec08254-83de-4049-8a62-4dba35bcaabd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:27:57 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[91454740-4f8e-479c-af18-9789580d94fa]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0e5aa34f-7442-4aa5-a7d5-fe21f2c3be6b tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:57 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ab1bca52-ae68-4e38-a440-443b61ad6979 tempest-CinderUnicodeTest-1134404644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.009s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:57 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-ab1bca52-ae68-4e38-a440-443b61ad6979 tempest-CinderUnicodeTest-1134404644 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:27:57 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-ab1bca52-ae68-4e38-a440-443b61ad6979 tempest-CinderUnicodeTest-1134404644 None] Deleted volume successfully. Jul 08 01:27:57 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd Jul 08 01:27:57 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:57 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ab1bca52-ae68-4e38-a440-443b61ad6979 tempest-CinderUnicodeTest-1134404644 None] Lock "cinder-f899eee5-8e53-40cd-a37d-cadf20aa30e8-delete_volume" released by "delete_volume" :: held 3.205s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:57 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-32f4fa69-fb62-4900-b23b-9a5b47c1943b tempest-CinderUnicodeTest-1134404644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e71f11f4-31d3-4328-a366-b586cc54ca3c" returned: 0 in 0.995s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-32f4fa69-fb62-4900-b23b-9a5b47c1943b tempest-CinderUnicodeTest-1134404644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e71f11f4-31d3-4328-a366-b586cc54ca3c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:57 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e71f11f4-31d3-4328-a366-b586cc54ca3c Jul 08 01:27:57 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:57 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b5d79d43-1b8e-4c60-82ea-0bca58b05877 tempest-VolumeDependencyTests-1880504022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a.c457a3ce-c8a3-443a-9616-a73011a10d1b" returned: 0 in 0.903s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b5d79d43-1b8e-4c60-82ea-0bca58b05877 tempest-VolumeDependencyTests-1880504022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:57 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a.info Jul 08 01:27:57 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:58 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0e5aa34f-7442-4aa5-a7d5-fe21f2c3be6b tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd" returned: 0 in 0.891s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0e5aa34f-7442-4aa5-a7d5-fe21f2c3be6b tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd.89da8d23-3c9c-484d-ac04-cd5b7dea4a82 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:58 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd.89da8d23-3c9c-484d-ac04-cd5b7dea4a82 Jul 08 01:27:58 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:58 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-32f4fa69-fb62-4900-b23b-9a5b47c1943b tempest-CinderUnicodeTest-1134404644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e71f11f4-31d3-4328-a366-b586cc54ca3c" returned: 0 in 0.710s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-32f4fa69-fb62-4900-b23b-9a5b47c1943b tempest-CinderUnicodeTest-1134404644 None] Lock "cinder-quobyte-e71f11f4-31d3-4328-a366-b586cc54ca3c" released by "delete_volume" :: held 1.752s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:58 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-32f4fa69-fb62-4900-b23b-9a5b47c1943b tempest-CinderUnicodeTest-1134404644 None] Created reservations ['d1e17993-3ae2-4df9-902f-27dd80c26449', 'f7e29c31-3daf-4653-88e0-56e99125b74b', '14b91fce-b715-4558-b61f-a7114f80cf10', 'bf38ecdf-8d35-49cb-8dd4-cdbfa90839cb'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:58 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b5d79d43-1b8e-4c60-82ea-0bca58b05877 tempest-VolumeDependencyTests-1880504022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a.info" returned: 0 in 0.680s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:58 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-b5d79d43-1b8e-4c60-82ea-0bca58b05877 tempest-VolumeDependencyTests-1880504022 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a.info is being set with open permissions: ugo+rw Jul 08 01:27:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b5d79d43-1b8e-4c60-82ea-0bca58b05877 tempest-VolumeDependencyTests-1880504022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:58 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a.info Jul 08 01:27:58 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-32f4fa69-fb62-4900-b23b-9a5b47c1943b tempest-CinderUnicodeTest-1134404644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-32f4fa69-fb62-4900-b23b-9a5b47c1943b tempest-CinderUnicodeTest-1134404644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-32f4fa69-fb62-4900-b23b-9a5b47c1943b tempest-CinderUnicodeTest-1134404644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-32f4fa69-fb62-4900-b23b-9a5b47c1943b tempest-CinderUnicodeTest-1134404644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-32f4fa69-fb62-4900-b23b-9a5b47c1943b tempest-CinderUnicodeTest-1134404644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-32f4fa69-fb62-4900-b23b-9a5b47c1943b tempest-CinderUnicodeTest-1134404644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:58 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:27:58 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:59 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0e5aa34f-7442-4aa5-a7d5-fe21f2c3be6b tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd.89da8d23-3c9c-484d-ac04-cd5b7dea4a82" returned: 0 in 0.917s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0e5aa34f-7442-4aa5-a7d5-fe21f2c3be6b tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd.89da8d23-3c9c-484d-ac04-cd5b7dea4a82 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:59 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd.89da8d23-3c9c-484d-ac04-cd5b7dea4a82 Jul 08 01:27:59 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:59 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b5d79d43-1b8e-4c60-82ea-0bca58b05877 tempest-VolumeDependencyTests-1880504022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a.info" returned: 0 in 0.716s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b5d79d43-1b8e-4c60-82ea-0bca58b05877 tempest-VolumeDependencyTests-1880504022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.746s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.131s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-641159703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb91f621-6665-45e7-860c-ac0c1df0c81c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7fee074c694d51b8bc0f7e906a5c15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:55Z,use_quota=True,user_id='e9d9d382133d4aa59333317799ac586a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:27:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Creating volume bb91f621-6665-45e7-860c-ac0c1df0c81c {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:27:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:27:59 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:27:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bb91f621-6665-45e7-860c-ac0c1df0c81c 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:59 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bb91f621-6665-45e7-860c-ac0c1df0c81c 1073741824 Jul 08 01:27:59 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:59 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-b5d79d43-1b8e-4c60-82ea-0bca58b05877 tempest-VolumeDependencyTests-1880504022 None] Create snapshot completed successfully Jul 08 01:27:59 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-32f4fa69-fb62-4900-b23b-9a5b47c1943b tempest-CinderUnicodeTest-1134404644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.843s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:59 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-32f4fa69-fb62-4900-b23b-9a5b47c1943b tempest-CinderUnicodeTest-1134404644 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:27:59 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-32f4fa69-fb62-4900-b23b-9a5b47c1943b tempest-CinderUnicodeTest-1134404644 None] Deleted volume successfully. Jul 08 01:27:59 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-32f4fa69-fb62-4900-b23b-9a5b47c1943b tempest-CinderUnicodeTest-1134404644 None] Lock "cinder-e71f11f4-31d3-4328-a366-b586cc54ca3c-delete_volume" released by "delete_volume" :: held 2.921s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:59 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0e5aa34f-7442-4aa5-a7d5-fe21f2c3be6b tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd.89da8d23-3c9c-484d-ac04-cd5b7dea4a82" returned: 0 in 0.860s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:00 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0e5aa34f-7442-4aa5-a7d5-fe21f2c3be6b tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-quobyte-89da8d23-3c9c-484d-ac04-cd5b7dea4a82" released by "_delete_snapshot" :: held 3.871s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:00 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0e5aa34f-7442-4aa5-a7d5-fe21f2c3be6b tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-quobyte-aec08254-83de-4049-8a62-4dba35bcaabd" released by "delete_snapshot" :: held 3.920s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:00 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-0e5aa34f-7442-4aa5-a7d5-fe21f2c3be6b tempest-CreateVolumesFromSnapshotTest-414282402 None] Created reservations ['7d3aaa7e-0aeb-47ff-8ee5-52c6c784ae40', '5d0a7bdc-a1bd-4a80-97bc-559513f96a6b', '6f3d4c05-7784-473d-acbb-7d710558edab', 'cc4de662-2763-4f9d-bd3e-dafb17e86b53'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:00 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-0e5aa34f-7442-4aa5-a7d5-fe21f2c3be6b tempest-CreateVolumesFromSnapshotTest-414282402 None] Delete snapshot completed successfully. Jul 08 01:28:00 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0e5aa34f-7442-4aa5-a7d5-fe21f2c3be6b tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-89da8d23-3c9c-484d-ac04-cd5b7dea4a82-delete_snapshot" released by "delete_snapshot" :: held 4.123s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:00 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bb91f621-6665-45e7-860c-ac0c1df0c81c 1073741824" returned: 0 in 1.098s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:00 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1da58fb1-647b-456b-a449-faddfae92a46 tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "cinder-aec08254-83de-4049-8a62-4dba35bcaabd-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:00 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1da58fb1-647b-456b-a449-faddfae92a46 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-aec08254-83de-4049-8a62-4dba35bcaabd-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bb91f621-6665-45e7-860c-ac0c1df0c81c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:00 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bb91f621-6665-45e7-860c-ac0c1df0c81c Jul 08 01:28:00 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:00 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1da58fb1-647b-456b-a449-faddfae92a46 tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "cinder-quobyte-aec08254-83de-4049-8a62-4dba35bcaabd" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:00 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1da58fb1-647b-456b-a449-faddfae92a46 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-quobyte-aec08254-83de-4049-8a62-4dba35bcaabd" acquired by "delete_volume" :: waited 0.016s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:00 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[24804304-b5e9-4330-ade8-243143e0fc88]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1da58fb1-647b-456b-a449-faddfae92a46 tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:00 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:28:00 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd Jul 08 01:28:00 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Flow 'volume_create_manager' (21c16f38-c7f9-41e1-97ed-8be398f81f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0efaef27-acdb-4e70-a708-6ad22bc733c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0efaef27-acdb-4e70-a708-6ad22bc733c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-114531217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e06158b2-cc7d-400d-8053-8a154add9926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2339b16c7ebc43a990543c9cca410e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c457a3ce-c8a3-443a-9616-a73011a10d1b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:01Z,use_quota=True,user_id='17c531f647404919acc3c762da37c59c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c995675d-0fbe-4094-a60a-665ac7f4b93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c995675d-0fbe-4094-a60a-665ac7f4b93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9640a0-7c32-4c06-94d2-ae0059ccf617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9640a0-7c32-4c06-94d2-ae0059ccf617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e06158b2-cc7d-400d-8053-8a154add9926', 'volume_name': 'volume-e06158b2-cc7d-400d-8053-8a154add9926', 'volume_size': 1, 'snapshot_id': 'c457a3ce-c8a3-443a-9616-a73011a10d1b'}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2c325c-0137-43c9-8349-09dfac57f79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2c325c-0137-43c9-8349-09dfac57f79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4cced1-a67e-4575-b21c-b92cbdfa308c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:00 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Volume e06158b2-cc7d-400d-8053-8a154add9926: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e06158b2-cc7d-400d-8053-8a154add9926', 'volume_size': 1, 'snapshot_id': 'c457a3ce-c8a3-443a-9616-a73011a10d1b'} Jul 08 01:28:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:01 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bb91f621-6665-45e7-860c-ac0c1df0c81c" returned: 0 in 0.899s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] <== create_volume: return (2105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:28:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.111s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.567s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:01 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Acquiring lock "cinder-quobyte-c457a3ce-c8a3-443a-9616-a73011a10d1b-e06158b2-cc7d-400d-8053-8a154add9926" by "_create_volume_from_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b524f63-cd73-4d54-803a-cb3e3deca634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb91f621-6665-45e7-860c-ac0c1df0c81c', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da5c7c5-bc29-4f89-87d5-94d2ce87aa73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:01 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Lock "cinder-quobyte-c457a3ce-c8a3-443a-9616-a73011a10d1b-e06158b2-cc7d-400d-8053-8a154add9926" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Creating volume e06158b2-cc7d-400d-8053-8a154add9926 from snapshot c457a3ce-c8a3-443a-9616-a73011a10d1b {{(pid=87022) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:28:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:28:01 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Acquiring lock "cinder-quobyte-e06158b2-cc7d-400d-8053-8a154add9926" by "_copy_volume_from_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:01 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Volume volume-bb91f621-6665-45e7-860c-ac0c1df0c81c (bb91f621-6665-45e7-860c-ac0c1df0c81c): created successfully Jul 08 01:28:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da5c7c5-bc29-4f89-87d5-94d2ce87aa73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Flow 'volume_create_manager' (0db39310-28ab-4eb7-b968-94a79e524080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:01 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Lock "cinder-quobyte-e06158b2-cc7d-400d-8053-8a154add9926" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] snapshot: c457a3ce-c8a3-443a-9616-a73011a10d1b, volume: e06158b2-cc7d-400d-8053-8a154add9926, {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:28:01 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-3c915640-1368-4a23-957c-567e10cf0534 tempest-ProjectReaderTests-1850597384 None] Created volume successfully. Jul 08 01:28:01 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1da58fb1-647b-456b-a449-faddfae92a46 tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd" returned: 0 in 0.887s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1da58fb1-647b-456b-a449-faddfae92a46 tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:01 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd Jul 08 01:28:01 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:01 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ff2c16-5a8c-4f06-b3f4-36f3b738e944]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a.c457a3ce-c8a3-443a-9616-a73011a10d1b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:01 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a.c457a3ce-c8a3-443a-9616-a73011a10d1b Jul 08 01:28:01 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:02 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e2f7a8ba-f0dc-469a-8e39-92672927bdfc tempest-ProjectReaderTests-1850597384 None] Acquiring lock "cinder-bb91f621-6665-45e7-860c-ac0c1df0c81c-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:02 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e2f7a8ba-f0dc-469a-8e39-92672927bdfc tempest-ProjectReaderTests-1850597384 None] Lock "cinder-bb91f621-6665-45e7-860c-ac0c1df0c81c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:02 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e2f7a8ba-f0dc-469a-8e39-92672927bdfc tempest-ProjectReaderTests-1850597384 None] Acquiring lock "cinder-quobyte-bb91f621-6665-45e7-860c-ac0c1df0c81c" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:02 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e2f7a8ba-f0dc-469a-8e39-92672927bdfc tempest-ProjectReaderTests-1850597384 None] Lock "cinder-quobyte-bb91f621-6665-45e7-860c-ac0c1df0c81c" acquired by "delete_volume" :: waited 0.025s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:02 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[845b6b22-5b2e-4527-bf19-e2d0a6733559]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e2f7a8ba-f0dc-469a-8e39-92672927bdfc tempest-ProjectReaderTests-1850597384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bb91f621-6665-45e7-860c-ac0c1df0c81c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:02 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bb91f621-6665-45e7-860c-ac0c1df0c81c Jul 08 01:28:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1da58fb1-647b-456b-a449-faddfae92a46 tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-aec08254-83de-4049-8a62-4dba35bcaabd" returned: 0 in 1.049s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:02 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:02 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:02 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1da58fb1-647b-456b-a449-faddfae92a46 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-quobyte-aec08254-83de-4049-8a62-4dba35bcaabd" released by "delete_volume" :: held 2.039s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:02 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-1da58fb1-647b-456b-a449-faddfae92a46 tempest-CreateVolumesFromSnapshotTest-414282402 None] Created reservations ['e4b0fca7-a894-4c83-9b2d-61bca39144b6', '68544206-03d4-43d4-bc72-f816f86460e2', '63c40589-7b6a-4f48-8192-ec05bd3de6fe', '5d5ece03-6e45-43fc-aa69-99ddc60a0e65'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:02 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a.c457a3ce-c8a3-443a-9616-a73011a10d1b" returned: 0 in 1.164s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67740ab5-2dda-497c-ba11-53ac1516e06a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:28:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] will copy from snapshot at /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:28:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Creating direct copy from snapshot {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:28:02 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb8be6e-a0d3-4d8d-a4cd-b383e325df90]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1da58fb1-647b-456b-a449-faddfae92a46 tempest-CreateVolumesFromSnapshotTest-414282402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1da58fb1-647b-456b-a449-faddfae92a46 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1da58fb1-647b-456b-a449-faddfae92a46 tempest-CreateVolumesFromSnapshotTest-414282402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1da58fb1-647b-456b-a449-faddfae92a46 tempest-CreateVolumesFromSnapshotTest-414282402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1da58fb1-647b-456b-a449-faddfae92a46 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1da58fb1-647b-456b-a449-faddfae92a46 tempest-CreateVolumesFromSnapshotTest-414282402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:02 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:28:02 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:03 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a Jul 08 01:28:03 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:03 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e2f7a8ba-f0dc-469a-8e39-92672927bdfc tempest-ProjectReaderTests-1850597384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bb91f621-6665-45e7-860c-ac0c1df0c81c" returned: 0 in 1.092s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e2f7a8ba-f0dc-469a-8e39-92672927bdfc tempest-ProjectReaderTests-1850597384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bb91f621-6665-45e7-860c-ac0c1df0c81c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:03 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bb91f621-6665-45e7-860c-ac0c1df0c81c Jul 08 01:28:03 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:03 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1da58fb1-647b-456b-a449-faddfae92a46 tempest-CreateVolumesFromSnapshotTest-414282402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.747s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:03 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-1da58fb1-647b-456b-a449-faddfae92a46 tempest-CreateVolumesFromSnapshotTest-414282402 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:03 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-1da58fb1-647b-456b-a449-faddfae92a46 tempest-CreateVolumesFromSnapshotTest-414282402 None] Deleted volume successfully. Jul 08 01:28:03 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1da58fb1-647b-456b-a449-faddfae92a46 tempest-CreateVolumesFromSnapshotTest-414282402 None] Lock "cinder-aec08254-83de-4049-8a62-4dba35bcaabd-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:03 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a" returned: 0 in 0.992s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:03 devstack cinder-volume[87022]: DEBUG cinder.utils [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Path /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e06158b2-cc7d-400d-8053-8a154add9926 not found in is_blk_device check {{(pid=87022) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:28:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e06158b2-cc7d-400d-8053-8a154add9926 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:03 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e06158b2-cc7d-400d-8053-8a154add9926 Jul 08 01:28:03 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:04 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e2f7a8ba-f0dc-469a-8e39-92672927bdfc tempest-ProjectReaderTests-1850597384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-bb91f621-6665-45e7-860c-ac0c1df0c81c" returned: 0 in 0.762s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:04 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e2f7a8ba-f0dc-469a-8e39-92672927bdfc tempest-ProjectReaderTests-1850597384 None] Lock "cinder-quobyte-bb91f621-6665-45e7-860c-ac0c1df0c81c" released by "delete_volume" :: held 1.916s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:04 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-e2f7a8ba-f0dc-469a-8e39-92672927bdfc tempest-ProjectReaderTests-1850597384 None] Created reservations ['4e9ef5b9-22b7-4b98-8743-3ae26f379b33', 'a521ebfb-7cf7-4725-bb01-0c4a2a6322e1', '1490d862-2760-4fcb-bf9d-0a96653eba9d', '06f23a0f-dae8-4f14-98db-c4d6f2dd740d'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e2f7a8ba-f0dc-469a-8e39-92672927bdfc tempest-ProjectReaderTests-1850597384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e2f7a8ba-f0dc-469a-8e39-92672927bdfc tempest-ProjectReaderTests-1850597384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e2f7a8ba-f0dc-469a-8e39-92672927bdfc tempest-ProjectReaderTests-1850597384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e2f7a8ba-f0dc-469a-8e39-92672927bdfc tempest-ProjectReaderTests-1850597384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e2f7a8ba-f0dc-469a-8e39-92672927bdfc tempest-ProjectReaderTests-1850597384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e2f7a8ba-f0dc-469a-8e39-92672927bdfc tempest-ProjectReaderTests-1850597384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:04 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:28:04 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:05 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:UPDATE=193,cinder:SELECT=143,cinder:DELETE=16,cinder:INSERT=45 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:28:05 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=132,cinder:UPDATE=180,cinder:INSERT=52,cinder:DELETE=17 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:28:05 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:28:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Flow 'volume_create_manager' (d93161b6-bc52-4897-b159-97242a044f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7975571b-8fd1-4553-83d9-c87658d6ae40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7975571b-8fd1-4553-83d9-c87658d6ae40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-322680706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b289a6c-9743-40e9-a4f5-a8cd7577e112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7fee074c694d51b8bc0f7e906a5c15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:06Z,use_quota=True,user_id='e9d9d382133d4aa59333317799ac586a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:05 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81890ba5-7644-4c90-b123-685ec60ee6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81890ba5-7644-4c90-b123-685ec60ee6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e8c360-7b3e-4065-9a2e-6d850bad6740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e8c360-7b3e-4065-9a2e-6d850bad6740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b289a6c-9743-40e9-a4f5-a8cd7577e112', 'volume_name': 'volume-7b289a6c-9743-40e9-a4f5-a8cd7577e112', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d2cab7-dfa5-428a-893d-64d268df4a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d2cab7-dfa5-428a-893d-64d268df4a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f2e9e36-f56d-4f02-953d-70a118b9090a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:06 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Volume 7b289a6c-9743-40e9-a4f5-a8cd7577e112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b289a6c-9743-40e9-a4f5-a8cd7577e112', 'volume_size': 1} Jul 08 01:28:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:06 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e2f7a8ba-f0dc-469a-8e39-92672927bdfc tempest-ProjectReaderTests-1850597384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.674s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:06 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-e2f7a8ba-f0dc-469a-8e39-92672927bdfc tempest-ProjectReaderTests-1850597384 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:06 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-e2f7a8ba-f0dc-469a-8e39-92672927bdfc tempest-ProjectReaderTests-1850597384 None] Deleted volume successfully. Jul 08 01:28:06 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-e2f7a8ba-f0dc-469a-8e39-92672927bdfc tempest-ProjectReaderTests-1850597384 None] Lock "cinder-bb91f621-6665-45e7-860c-ac0c1df0c81c-delete_volume" released by "delete_volume" :: held 4.015s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:10 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e06158b2-cc7d-400d-8053-8a154add9926" returned: 0 in 6.701s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:10 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede54361-e59e-409b-92b0-49b0a85d0185]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:10 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a Jul 08 01:28:10 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:11 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:28:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Flow 'volume_create_manager' (c4477abd-b844-4fa7-8f90-bbcb69b2ee59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b310e8-47d4-4511-8527-c43fef0f8981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b310e8-47d4-4511-8527-c43fef0f8981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-501295882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a32532-1071-48cd-90a3-a5ada3b18fa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f452df384f48eb83e90aada847912b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:11Z,use_quota=True,user_id='b30345ecbc75478bb89b7973fce27193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1abade9e-6351-402f-ad9d-2f8d833fa7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1abade9e-6351-402f-ad9d-2f8d833fa7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef2a6063-56ab-47c6-8d29-e2a84ac4bdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef2a6063-56ab-47c6-8d29-e2a84ac4bdb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8a32532-1071-48cd-90a3-a5ada3b18fa4', 'volume_name': 'volume-a8a32532-1071-48cd-90a3-a5ada3b18fa4', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (763b50df-ae41-4cd1-a67b-47530ee1d94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (763b50df-ae41-4cd1-a67b-47530ee1d94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:11 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bfa423c-ac40-4ace-b2ca-ea94a79a7549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:11 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Volume a8a32532-1071-48cd-90a3-a5ada3b18fa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8a32532-1071-48cd-90a3-a5ada3b18fa4', 'volume_size': 1} Jul 08 01:28:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:11 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a" returned: 0 in 1.143s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:11 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Image conversion details: src /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a, size 1024.00 MB, duration 6.70 sec, destination /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e06158b2-cc7d-400d-8053-8a154add9926 {{(pid=87022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:28:11 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Converted 1024.00 MB image at 152.77 MB/s Jul 08 01:28:11 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e06158b2-cc7d-400d-8053-8a154add9926 is being set with open permissions: ugo+rw Jul 08 01:28:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e06158b2-cc7d-400d-8053-8a154add9926 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:11 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e06158b2-cc7d-400d-8053-8a154add9926 Jul 08 01:28:11 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:12 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e06158b2-cc7d-400d-8053-8a154add9926" returned: 0 in 0.674s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:12 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Lock "cinder-quobyte-e06158b2-cc7d-400d-8053-8a154add9926" released by "_copy_volume_from_snapshot" :: held 10.888s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:12 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Lock "cinder-quobyte-c457a3ce-c8a3-443a-9616-a73011a10d1b-e06158b2-cc7d-400d-8053-8a154add9926" released by "_create_volume_from_snapshot" :: held 10.951s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.992s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.337s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:12 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-322680706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b289a6c-9743-40e9-a4f5-a8cd7577e112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7fee074c694d51b8bc0f7e906a5c15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:06Z,use_quota=True,user_id='e9d9d382133d4aa59333317799ac586a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:28:12 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Creating volume 7b289a6c-9743-40e9-a4f5-a8cd7577e112 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:28:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:12 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:12 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:12 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:28:12 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:28:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b289a6c-9743-40e9-a4f5-a8cd7577e112 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:12 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b289a6c-9743-40e9-a4f5-a8cd7577e112 1073741824 Jul 08 01:28:12 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4cced1-a67e-4575-b21c-b92cbdfa308c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e06158b2-cc7d-400d-8053-8a154add9926', 'volume_size': 1, 'snapshot_id': 'c457a3ce-c8a3-443a-9616-a73011a10d1b'}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd325d0-e509-46cf-bfc3-153cad304f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:12 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Volume volume-e06158b2-cc7d-400d-8053-8a154add9926 (e06158b2-cc7d-400d-8053-8a154add9926): created successfully Jul 08 01:28:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd325d0-e509-46cf-bfc3-153cad304f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:12 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Flow 'volume_create_manager' (21c16f38-c7f9-41e1-97ed-8be398f81f76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:12 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-d79d8ad8-aaaf-41ee-b959-2c4326094116 tempest-VolumeDependencyTests-1880504022 None] Created volume successfully. Jul 08 01:28:13 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b289a6c-9743-40e9-a4f5-a8cd7577e112 1073741824" returned: 0 in 1.003s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b289a6c-9743-40e9-a4f5-a8cd7577e112 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:13 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b289a6c-9743-40e9-a4f5-a8cd7577e112 Jul 08 01:28:13 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:13 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-67f7c194-fd99-4652-ae3d-035d1a9b41fb tempest-VolumeDependencyTests-1880504022 None] Acquiring lock "cinder-c457a3ce-c8a3-443a-9616-a73011a10d1b-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:13 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-67f7c194-fd99-4652-ae3d-035d1a9b41fb tempest-VolumeDependencyTests-1880504022 None] Lock "cinder-c457a3ce-c8a3-443a-9616-a73011a10d1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:13 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-67f7c194-fd99-4652-ae3d-035d1a9b41fb tempest-VolumeDependencyTests-1880504022 None] Acquiring lock "cinder-quobyte-67740ab5-2dda-497c-ba11-53ac1516e06a" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:13 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-67f7c194-fd99-4652-ae3d-035d1a9b41fb tempest-VolumeDependencyTests-1880504022 None] Lock "cinder-quobyte-67740ab5-2dda-497c-ba11-53ac1516e06a" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:13 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-67f7c194-fd99-4652-ae3d-035d1a9b41fb tempest-VolumeDependencyTests-1880504022 None] Acquiring lock "cinder-quobyte-c457a3ce-c8a3-443a-9616-a73011a10d1b" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:13 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-67f7c194-fd99-4652-ae3d-035d1a9b41fb tempest-VolumeDependencyTests-1880504022 None] Lock "cinder-quobyte-c457a3ce-c8a3-443a-9616-a73011a10d1b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-67f7c194-fd99-4652-ae3d-035d1a9b41fb tempest-VolumeDependencyTests-1880504022 None] Deleting offline snapshot c457a3ce-c8a3-443a-9616-a73011a10d1b of volume 67740ab5-2dda-497c-ba11-53ac1516e06a {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:28:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-67f7c194-fd99-4652-ae3d-035d1a9b41fb tempest-VolumeDependencyTests-1880504022 None] snapshot_file for this snap is: volume-67740ab5-2dda-497c-ba11-53ac1516e06a.c457a3ce-c8a3-443a-9616-a73011a10d1b {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:28:13 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[233eb631-e23f-4174-ac38-afe90d38300c]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-67f7c194-fd99-4652-ae3d-035d1a9b41fb tempest-VolumeDependencyTests-1880504022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a.c457a3ce-c8a3-443a-9616-a73011a10d1b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:13 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:28:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Flow 'volume_create_manager' (764be87f-d59a-4c9c-81d0-d861bff26afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1b1be5-fd82-45fd-9538-ceddbe5f144e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1b1be5-fd82-45fd-9538-ceddbe5f144e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1189452492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4379c4-c04c-4862-9b5f-d4f767c9dd0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef33caddaf744243b8124f7dd8c4d1e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:14Z,use_quota=True,user_id='b01a5b33fd3a461a963e8aa3700add02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (627cce0b-db4c-4ec2-abac-55eaf6fb3cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (627cce0b-db4c-4ec2-abac-55eaf6fb3cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05178b2c-4868-4b20-b095-da866e913f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05178b2c-4868-4b20-b095-da866e913f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee4379c4-c04c-4862-9b5f-d4f767c9dd0c', 'volume_name': 'volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:13 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a.c457a3ce-c8a3-443a-9616-a73011a10d1b Jul 08 01:28:13 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dbb1e02-a147-4071-baf9-0d463f8ab6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dbb1e02-a147-4071-baf9-0d463f8ab6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1b5dc8-06b6-4db4-8e6f-5de3943fafac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:13 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Volume ee4379c4-c04c-4862-9b5f-d4f767c9dd0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c', 'volume_size': 1} Jul 08 01:28:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:14 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b289a6c-9743-40e9-a4f5-a8cd7577e112" returned: 0 in 0.919s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:28:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.005s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.028s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-501295882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a32532-1071-48cd-90a3-a5ada3b18fa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f452df384f48eb83e90aada847912b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:11Z,use_quota=True,user_id='b30345ecbc75478bb89b7973fce27193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:28:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Creating volume a8a32532-1071-48cd-90a3-a5ada3b18fa4 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:28:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:28:14 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:28:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a8a32532-1071-48cd-90a3-a5ada3b18fa4 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:14 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a8a32532-1071-48cd-90a3-a5ada3b18fa4 1073741824 Jul 08 01:28:14 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f2e9e36-f56d-4f02-953d-70a118b9090a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b289a6c-9743-40e9-a4f5-a8cd7577e112', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66db25ed-6180-4cbf-919b-9695d511f74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:14 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Volume volume-7b289a6c-9743-40e9-a4f5-a8cd7577e112 (7b289a6c-9743-40e9-a4f5-a8cd7577e112): created successfully Jul 08 01:28:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66db25ed-6180-4cbf-919b-9695d511f74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:14 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Flow 'volume_create_manager' (d93161b6-bc52-4897-b159-97242a044f0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:14 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-4241ff9a-fcc5-4d3f-b5d1-9155a1ad3dee tempest-ProjectReaderTests-1850597384 None] Created volume successfully. Jul 08 01:28:14 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-67f7c194-fd99-4652-ae3d-035d1a9b41fb tempest-VolumeDependencyTests-1880504022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a.c457a3ce-c8a3-443a-9616-a73011a10d1b" returned: 0 in 0.920s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-67f7c194-fd99-4652-ae3d-035d1a9b41fb tempest-VolumeDependencyTests-1880504022 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67740ab5-2dda-497c-ba11-53ac1516e06a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:28:14 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d1de46-a408-463d-be29-043a623f5b42]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-67f7c194-fd99-4652-ae3d-035d1a9b41fb tempest-VolumeDependencyTests-1880504022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:14 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a Jul 08 01:28:14 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:15 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a8a32532-1071-48cd-90a3-a5ada3b18fa4 1073741824" returned: 0 in 0.969s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a8a32532-1071-48cd-90a3-a5ada3b18fa4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:15 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a8a32532-1071-48cd-90a3-a5ada3b18fa4 Jul 08 01:28:15 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6e2b1b46-cb5d-491c-87a2-b9d5738c52d9 tempest-ProjectReaderTests-1850597384 None] Acquiring lock "cinder-7b289a6c-9743-40e9-a4f5-a8cd7577e112-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6e2b1b46-cb5d-491c-87a2-b9d5738c52d9 tempest-ProjectReaderTests-1850597384 None] Lock "cinder-7b289a6c-9743-40e9-a4f5-a8cd7577e112-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6e2b1b46-cb5d-491c-87a2-b9d5738c52d9 tempest-ProjectReaderTests-1850597384 None] Acquiring lock "cinder-quobyte-7b289a6c-9743-40e9-a4f5-a8cd7577e112" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6e2b1b46-cb5d-491c-87a2-b9d5738c52d9 tempest-ProjectReaderTests-1850597384 None] Lock "cinder-quobyte-7b289a6c-9743-40e9-a4f5-a8cd7577e112" acquired by "delete_volume" :: waited 0.020s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:15 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c61099-42fe-473c-aac8-78f55e9f61b0]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6e2b1b46-cb5d-491c-87a2-b9d5738c52d9 tempest-ProjectReaderTests-1850597384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b289a6c-9743-40e9-a4f5-a8cd7577e112 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:15 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-67f7c194-fd99-4652-ae3d-035d1a9b41fb tempest-VolumeDependencyTests-1880504022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a" returned: 0 in 1.001s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-67f7c194-fd99-4652-ae3d-035d1a9b41fb tempest-VolumeDependencyTests-1880504022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a.c457a3ce-c8a3-443a-9616-a73011a10d1b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:15 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a.c457a3ce-c8a3-443a-9616-a73011a10d1b Jul 08 01:28:15 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:15 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b289a6c-9743-40e9-a4f5-a8cd7577e112 Jul 08 01:28:15 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:16 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a8a32532-1071-48cd-90a3-a5ada3b18fa4" returned: 0 in 1.095s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] <== create_volume: return (2122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:28:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.126s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.610s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1189452492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4379c4-c04c-4862-9b5f-d4f767c9dd0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef33caddaf744243b8124f7dd8c4d1e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:14Z,use_quota=True,user_id='b01a5b33fd3a461a963e8aa3700add02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:28:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Creating volume ee4379c4-c04c-4862-9b5f-d4f767c9dd0c {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:28:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:28:16 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:28:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:16 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c 1073741824 Jul 08 01:28:16 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bfa423c-ac40-4ace-b2ca-ea94a79a7549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8a32532-1071-48cd-90a3-a5ada3b18fa4', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e42d50b9-08b3-4dfc-9cf0-0c039a1ec033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:16 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Volume volume-a8a32532-1071-48cd-90a3-a5ada3b18fa4 (a8a32532-1071-48cd-90a3-a5ada3b18fa4): created successfully Jul 08 01:28:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e42d50b9-08b3-4dfc-9cf0-0c039a1ec033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Flow 'volume_create_manager' (c4477abd-b844-4fa7-8f90-bbcb69b2ee59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:16 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:16 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-48e6ae1c-8197-4f49-8a26-f2d2f17439af tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Created volume successfully. Jul 08 01:28:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6e2b1b46-cb5d-491c-87a2-b9d5738c52d9 tempest-ProjectReaderTests-1850597384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b289a6c-9743-40e9-a4f5-a8cd7577e112" returned: 0 in 0.966s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6e2b1b46-cb5d-491c-87a2-b9d5738c52d9 tempest-ProjectReaderTests-1850597384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b289a6c-9743-40e9-a4f5-a8cd7577e112 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:16 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b289a6c-9743-40e9-a4f5-a8cd7577e112 Jul 08 01:28:16 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:16 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-67f7c194-fd99-4652-ae3d-035d1a9b41fb tempest-VolumeDependencyTests-1880504022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a.c457a3ce-c8a3-443a-9616-a73011a10d1b" returned: 0 in 0.957s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-67f7c194-fd99-4652-ae3d-035d1a9b41fb tempest-VolumeDependencyTests-1880504022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a.c457a3ce-c8a3-443a-9616-a73011a10d1b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:16 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a.c457a3ce-c8a3-443a-9616-a73011a10d1b Jul 08 01:28:16 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:17 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6e2b1b46-cb5d-491c-87a2-b9d5738c52d9 tempest-ProjectReaderTests-1850597384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-7b289a6c-9743-40e9-a4f5-a8cd7577e112" returned: 0 in 0.792s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:17 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6e2b1b46-cb5d-491c-87a2-b9d5738c52d9 tempest-ProjectReaderTests-1850597384 None] Lock "cinder-quobyte-7b289a6c-9743-40e9-a4f5-a8cd7577e112" released by "delete_volume" :: held 1.818s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:17 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-67f7c194-fd99-4652-ae3d-035d1a9b41fb tempest-VolumeDependencyTests-1880504022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a.c457a3ce-c8a3-443a-9616-a73011a10d1b" returned: 0 in 0.767s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:17 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-67f7c194-fd99-4652-ae3d-035d1a9b41fb tempest-VolumeDependencyTests-1880504022 None] Lock "cinder-quobyte-c457a3ce-c8a3-443a-9616-a73011a10d1b" released by "_delete_snapshot" :: held 3.813s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:17 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-67f7c194-fd99-4652-ae3d-035d1a9b41fb tempest-VolumeDependencyTests-1880504022 None] Lock "cinder-quobyte-67740ab5-2dda-497c-ba11-53ac1516e06a" released by "delete_snapshot" :: held 3.853s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:17 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c 1073741824" returned: 0 in 1.016s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:17 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-6e2b1b46-cb5d-491c-87a2-b9d5738c52d9 tempest-ProjectReaderTests-1850597384 None] Created reservations ['3c8a35a8-9ad6-469f-af09-263862a2a236', 'c805d3ae-7586-46b7-9c24-8ece5ee80354', '48bca1c7-4f03-4d3a-a984-9ff3e51f1416', '16c7129c-22f0-4184-aee6-003681c4cea0'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:17 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c Jul 08 01:28:17 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:17 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-67f7c194-fd99-4652-ae3d-035d1a9b41fb tempest-VolumeDependencyTests-1880504022 None] Created reservations ['e8c9ba64-2fd4-4d26-b524-c360b9edde6c', '7426c509-e0ba-4047-a495-0d53af2143ab', 'eaf2e8fc-531d-43cd-8cfd-72f142ea25a5', '77491a30-f736-43d7-aca1-22a0ecce972a'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6e2b1b46-cb5d-491c-87a2-b9d5738c52d9 tempest-ProjectReaderTests-1850597384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6e2b1b46-cb5d-491c-87a2-b9d5738c52d9 tempest-ProjectReaderTests-1850597384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-6e2b1b46-cb5d-491c-87a2-b9d5738c52d9 tempest-ProjectReaderTests-1850597384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-6e2b1b46-cb5d-491c-87a2-b9d5738c52d9 tempest-ProjectReaderTests-1850597384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6e2b1b46-cb5d-491c-87a2-b9d5738c52d9 tempest-ProjectReaderTests-1850597384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6e2b1b46-cb5d-491c-87a2-b9d5738c52d9 tempest-ProjectReaderTests-1850597384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:17 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:28:17 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:17 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-67f7c194-fd99-4652-ae3d-035d1a9b41fb tempest-VolumeDependencyTests-1880504022 None] Delete snapshot completed successfully. Jul 08 01:28:17 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-67f7c194-fd99-4652-ae3d-035d1a9b41fb tempest-VolumeDependencyTests-1880504022 None] Lock "cinder-c457a3ce-c8a3-443a-9616-a73011a10d1b-delete_snapshot" released by "delete_snapshot" :: held 4.275s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-00dcbf07-b199-4665-8483-fd8998fa2729 tempest-VolumeDependencyTests-1880504022 None] Acquiring lock "cinder-67740ab5-2dda-497c-ba11-53ac1516e06a-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-00dcbf07-b199-4665-8483-fd8998fa2729 tempest-VolumeDependencyTests-1880504022 None] Lock "cinder-67740ab5-2dda-497c-ba11-53ac1516e06a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-00dcbf07-b199-4665-8483-fd8998fa2729 tempest-VolumeDependencyTests-1880504022 None] Acquiring lock "cinder-quobyte-67740ab5-2dda-497c-ba11-53ac1516e06a" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:18 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-00dcbf07-b199-4665-8483-fd8998fa2729 tempest-VolumeDependencyTests-1880504022 None] Lock "cinder-quobyte-67740ab5-2dda-497c-ba11-53ac1516e06a" acquired by "delete_volume" :: waited 0.083s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c" returned: 0 in 1.201s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] <== create_volume: return (2287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:28:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.290s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:18 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4c2b0a-5d67-4d6f-9f24-995f58074f02]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-00dcbf07-b199-4665-8483-fd8998fa2729 tempest-VolumeDependencyTests-1880504022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1b5dc8-06b6-4db4-8e6f-5de3943fafac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:18 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb60ceb-7fbb-48b4-81e5-fb08dde357f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6e2b1b46-cb5d-491c-87a2-b9d5738c52d9 tempest-ProjectReaderTests-1850597384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.164s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:18 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-6e2b1b46-cb5d-491c-87a2-b9d5738c52d9 tempest-ProjectReaderTests-1850597384 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:18 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:28:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Flow 'volume_create_manager' (900a8a15-c195-4ee8-a697-59bc9b6b93f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7706a4d3-fa31-4cc4-864b-f99795e99038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:19 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-6e2b1b46-cb5d-491c-87a2-b9d5738c52d9 tempest-ProjectReaderTests-1850597384 None] Deleted volume successfully. Jul 08 01:28:19 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a Jul 08 01:28:19 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:19 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Volume volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c (ee4379c4-c04c-4862-9b5f-d4f767c9dd0c): created successfully Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb60ceb-7fbb-48b4-81e5-fb08dde357f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Flow 'volume_create_manager' (764be87f-d59a-4c9c-81d0-d861bff26afe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7706a4d3-fa31-4cc4-864b-f99795e99038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-622513826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe1fb4e1-9948-4bf6-9ea1-af2ba6841adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f452df384f48eb83e90aada847912b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:19Z,use_quota=True,user_id='b30345ecbc75478bb89b7973fce27193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48909aaa-fbfc-4005-a69c-4b04e0dab945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48909aaa-fbfc-4005-a69c-4b04e0dab945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d43f6cf8-1d71-430d-83e5-4aa3b99c4164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d43f6cf8-1d71-430d-83e5-4aa3b99c4164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe1fb4e1-9948-4bf6-9ea1-af2ba6841adb', 'volume_name': 'volume-fe1fb4e1-9948-4bf6-9ea1-af2ba6841adb', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e966e0-ca99-40e0-975b-fef5700e96f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e966e0-ca99-40e0-975b-fef5700e96f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d77b485-6e28-40ea-a173-24541e6ae256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:19 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Volume fe1fb4e1-9948-4bf6-9ea1-af2ba6841adb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe1fb4e1-9948-4bf6-9ea1-af2ba6841adb', 'volume_size': 1} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-622513826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe1fb4e1-9948-4bf6-9ea1-af2ba6841adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f452df384f48eb83e90aada847912b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:19Z,use_quota=True,user_id='b30345ecbc75478bb89b7973fce27193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Creating volume fe1fb4e1-9948-4bf6-9ea1-af2ba6841adb {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:28:19 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fe1fb4e1-9948-4bf6-9ea1-af2ba6841adb 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:19 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fe1fb4e1-9948-4bf6-9ea1-af2ba6841adb 1073741824 Jul 08 01:28:19 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:19 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-d4e7a9d3-0162-4084-bc85-e5cf28e5f144 tempest-ProjectReaderTests-531722253 None] Created volume successfully. Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6e2b1b46-cb5d-491c-87a2-b9d5738c52d9 tempest-ProjectReaderTests-1850597384 None] Lock "cinder-7b289a6c-9743-40e9-a4f5-a8cd7577e112-delete_volume" released by "delete_volume" :: held 3.738s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Flow 'volume_create_manager' (b8888c02-0b17-4ec3-89f0-1460ea5e18d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b90ddeb-72a4-4ec2-a2e5-a432a7d4cf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Flow 'volume_create_manager' (efd2c52b-4c42-4ab3-80af-619aef5c020e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (915abf86-a46c-48b4-8480-306c4ab18788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b90ddeb-72a4-4ec2-a2e5-a432a7d4cf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2084157219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e3631d4-26aa-4d97-a719-ff42d6226f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f452df384f48eb83e90aada847912b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:19Z,use_quota=True,user_id='b30345ecbc75478bb89b7973fce27193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56123580-b59a-4136-a7e7-e93d72ba4d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56123580-b59a-4136-a7e7-e93d72ba4d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e21f17a-b48c-41dc-b934-4172cd1911e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e21f17a-b48c-41dc-b934-4172cd1911e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e3631d4-26aa-4d97-a719-ff42d6226f79', 'volume_name': 'volume-8e3631d4-26aa-4d97-a719-ff42d6226f79', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63aa78c3-e1ec-4151-8ca2-f35292bf9ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63aa78c3-e1ec-4151-8ca2-f35292bf9ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1fd9f03-98ca-4cd3-8880-ff3bc19db302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:19 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Volume 8e3631d4-26aa-4d97-a719-ff42d6226f79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e3631d4-26aa-4d97-a719-ff42d6226f79', 'volume_size': 1} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (915abf86-a46c-48b4-8480-306c4ab18788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1774342151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc5c5e1f-953f-41e8-a126-d11c20bec34e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7fee074c694d51b8bc0f7e906a5c15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:19Z,use_quota=True,user_id='e9d9d382133d4aa59333317799ac586a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc87e00-ce40-42b4-82b1-7a14b4046466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc87e00-ce40-42b4-82b1-7a14b4046466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95bef0a-2f37-45a8-9cfe-4bdcab522445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95bef0a-2f37-45a8-9cfe-4bdcab522445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc5c5e1f-953f-41e8-a126-d11c20bec34e', 'volume_name': 'volume-cc5c5e1f-953f-41e8-a126-d11c20bec34e', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5be7dad6-89d2-437d-896d-edcfb74cb821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5be7dad6-89d2-437d-896d-edcfb74cb821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ca5695-18fd-4081-b757-b96303522cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:19 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Volume cc5c5e1f-953f-41e8-a126-d11c20bec34e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc5c5e1f-953f-41e8-a126-d11c20bec34e', 'volume_size': 1} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Flow 'volume_create_manager' (af77d10e-8b4f-402b-b408-bf4fb08238fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:19 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2130afab-123f-4b47-8c75-37201a771f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:20 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2130afab-123f-4b47-8c75-37201a771f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-381197518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd3f483-0642-433f-a22d-80e9136c1180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f452df384f48eb83e90aada847912b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:20Z,use_quota=True,user_id='b30345ecbc75478bb89b7973fce27193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:20 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3b8f53-69bc-47fa-9101-fa5ff9fdb63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:20 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3b8f53-69bc-47fa-9101-fa5ff9fdb63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:20 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6aa254b-da70-45d9-9ce1-672aea4eee58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:20 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6aa254b-da70-45d9-9ce1-672aea4eee58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bd3f483-0642-433f-a22d-80e9136c1180', 'volume_name': 'volume-6bd3f483-0642-433f-a22d-80e9136c1180', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:20 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4cf1a1-130b-45dc-b42e-421bc2a4bd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:20 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4cf1a1-130b-45dc-b42e-421bc2a4bd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:20 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee9c389-c9c3-4e08-bf93-dc22e10301fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:20 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Volume 6bd3f483-0642-433f-a22d-80e9136c1180: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bd3f483-0642-433f-a22d-80e9136c1180', 'volume_size': 1} Jul 08 01:28:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1fcfdc84-97b0-438c-a0c6-5e72d4e474c7 tempest-ProjectReaderTests-531722253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:20 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-00dcbf07-b199-4665-8483-fd8998fa2729 tempest-VolumeDependencyTests-1880504022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a" returned: 0 in 1.410s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-00dcbf07-b199-4665-8483-fd8998fa2729 tempest-VolumeDependencyTests-1880504022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:20 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a Jul 08 01:28:20 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:20 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:28:20 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:20 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Flow 'volume_create_manager' (c66a01c4-76e3-4a44-a6f4-5b937db5c564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:20 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3189fb4e-ef95-48be-ae27-3231df3d0c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fe1fb4e1-9948-4bf6-9ea1-af2ba6841adb 1073741824" returned: 0 in 1.407s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:20 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3189fb4e-ef95-48be-ae27-3231df3d0c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2029017897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e330a1d-6ecc-49cd-b137-08e619b70f5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f452df384f48eb83e90aada847912b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:21Z,use_quota=True,user_id='b30345ecbc75478bb89b7973fce27193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:20 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (675fb251-31b0-4062-ade4-9f340296c9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:20 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (675fb251-31b0-4062-ade4-9f340296c9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:20 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9521d1ec-1399-4bc9-a064-e9f221f2cf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:20 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9521d1ec-1399-4bc9-a064-e9f221f2cf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e330a1d-6ecc-49cd-b137-08e619b70f5a', 'volume_name': 'volume-1e330a1d-6ecc-49cd-b137-08e619b70f5a', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:20 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80fe59f5-8f16-44da-99b3-527e3cf1abe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:20 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80fe59f5-8f16-44da-99b3-527e3cf1abe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:20 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2bc26d-75a3-414b-a1c1-9c23dc87059a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:20 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Volume 1e330a1d-6ecc-49cd-b137-08e619b70f5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e330a1d-6ecc-49cd-b137-08e619b70f5a', 'volume_size': 1} Jul 08 01:28:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fe1fb4e1-9948-4bf6-9ea1-af2ba6841adb {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:20 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fe1fb4e1-9948-4bf6-9ea1-af2ba6841adb Jul 08 01:28:20 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Flow 'volume_create_manager' (63e6f60b-02ee-43a2-8a06-2c073d7a8fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c776c9e8-7418-4be5-a9db-b5864c9c9a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c776c9e8-7418-4be5-a9db-b5864c9c9a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1887892611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=890331ac-4f2d-40fd-840d-788ef34773b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f452df384f48eb83e90aada847912b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:21Z,use_quota=True,user_id='b30345ecbc75478bb89b7973fce27193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ebc577-8738-4292-994e-053aeb225e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ebc577-8738-4292-994e-053aeb225e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82302fc6-66f7-49cf-b92e-5e53786ddd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82302fc6-66f7-49cf-b92e-5e53786ddd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '890331ac-4f2d-40fd-840d-788ef34773b1', 'volume_name': 'volume-890331ac-4f2d-40fd-840d-788ef34773b1', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f23d749c-8f27-43c0-8d98-af7e8ffe8096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f23d749c-8f27-43c0-8d98-af7e8ffe8096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0589ebf0-5bad-4591-ac05-2c344d061a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:21 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Volume 890331ac-4f2d-40fd-840d-788ef34773b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-890331ac-4f2d-40fd-840d-788ef34773b1', 'volume_size': 1} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:21 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-00dcbf07-b199-4665-8483-fd8998fa2729 tempest-VolumeDependencyTests-1880504022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-67740ab5-2dda-497c-ba11-53ac1516e06a" returned: 0 in 0.945s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-00dcbf07-b199-4665-8483-fd8998fa2729 tempest-VolumeDependencyTests-1880504022 None] Lock "cinder-quobyte-67740ab5-2dda-497c-ba11-53ac1516e06a" released by "delete_volume" :: held 2.483s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-00dcbf07-b199-4665-8483-fd8998fa2729 tempest-VolumeDependencyTests-1880504022 None] Created reservations ['30bccaad-f004-4614-b8e8-6ef6e627395d', 'f4021503-6924-4423-b70b-0d2b3a0a8515', '3d96b138-cb68-49dc-b656-f671825d7f8b', '86505438-00f3-475d-a7a9-4fc808348a93'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-00dcbf07-b199-4665-8483-fd8998fa2729 tempest-VolumeDependencyTests-1880504022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-00dcbf07-b199-4665-8483-fd8998fa2729 tempest-VolumeDependencyTests-1880504022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-00dcbf07-b199-4665-8483-fd8998fa2729 tempest-VolumeDependencyTests-1880504022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-00dcbf07-b199-4665-8483-fd8998fa2729 tempest-VolumeDependencyTests-1880504022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-00dcbf07-b199-4665-8483-fd8998fa2729 tempest-VolumeDependencyTests-1880504022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-00dcbf07-b199-4665-8483-fd8998fa2729 tempest-VolumeDependencyTests-1880504022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:21 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:28:21 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:21 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fe1fb4e1-9948-4bf6-9ea1-af2ba6841adb" returned: 0 in 0.700s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] <== create_volume: return (2208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.211s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.939s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2084157219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e3631d4-26aa-4d97-a719-ff42d6226f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f452df384f48eb83e90aada847912b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:19Z,use_quota=True,user_id='b30345ecbc75478bb89b7973fce27193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Creating volume 8e3631d4-26aa-4d97-a719-ff42d6226f79 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:28:21 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8e3631d4-26aa-4d97-a719-ff42d6226f79 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d77b485-6e28-40ea-a173-24541e6ae256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe1fb4e1-9948-4bf6-9ea1-af2ba6841adb', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:21 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8e3631d4-26aa-4d97-a719-ff42d6226f79 1073741824 Jul 08 01:28:21 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d30424-b2f4-4eda-9c68-40aa14222004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:21 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Volume volume-fe1fb4e1-9948-4bf6-9ea1-af2ba6841adb (fe1fb4e1-9948-4bf6-9ea1-af2ba6841adb): created successfully Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d30424-b2f4-4eda-9c68-40aa14222004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:21 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Flow 'volume_create_manager' (900a8a15-c195-4ee8-a697-59bc9b6b93f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:21 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-b212d943-c3ca-48a6-b8fe-cf118da3c190 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Created volume successfully. Jul 08 01:28:22 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-00dcbf07-b199-4665-8483-fd8998fa2729 tempest-VolumeDependencyTests-1880504022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.790s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:22 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-00dcbf07-b199-4665-8483-fd8998fa2729 tempest-VolumeDependencyTests-1880504022 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:22 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-00dcbf07-b199-4665-8483-fd8998fa2729 tempest-VolumeDependencyTests-1880504022 None] Deleted volume successfully. Jul 08 01:28:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-00dcbf07-b199-4665-8483-fd8998fa2729 tempest-VolumeDependencyTests-1880504022 None] Lock "cinder-67740ab5-2dda-497c-ba11-53ac1516e06a-delete_volume" released by "delete_volume" :: held 3.651s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ecc6fcd9-634e-4ed0-b0a1-38971ea9aee3 tempest-VolumeDependencyTests-1880504022 None] Acquiring lock "cinder-e06158b2-cc7d-400d-8053-8a154add9926-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ecc6fcd9-634e-4ed0-b0a1-38971ea9aee3 tempest-VolumeDependencyTests-1880504022 None] Lock "cinder-e06158b2-cc7d-400d-8053-8a154add9926-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ecc6fcd9-634e-4ed0-b0a1-38971ea9aee3 tempest-VolumeDependencyTests-1880504022 None] Acquiring lock "cinder-quobyte-e06158b2-cc7d-400d-8053-8a154add9926" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:22 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8e3631d4-26aa-4d97-a719-ff42d6226f79 1073741824" returned: 0 in 1.063s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ecc6fcd9-634e-4ed0-b0a1-38971ea9aee3 tempest-VolumeDependencyTests-1880504022 None] Lock "cinder-quobyte-e06158b2-cc7d-400d-8053-8a154add9926" acquired by "delete_volume" :: waited 0.024s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:22 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[9148e506-5cd7-41a2-bfad-f33f0a3d841a]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ecc6fcd9-634e-4ed0-b0a1-38971ea9aee3 tempest-VolumeDependencyTests-1880504022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e06158b2-cc7d-400d-8053-8a154add9926 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8e3631d4-26aa-4d97-a719-ff42d6226f79 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:22 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8e3631d4-26aa-4d97-a719-ff42d6226f79 Jul 08 01:28:22 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:22 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e06158b2-cc7d-400d-8053-8a154add9926 Jul 08 01:28:22 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:23 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8e3631d4-26aa-4d97-a719-ff42d6226f79" returned: 0 in 0.825s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] <== create_volume: return (1971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:28:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.849s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1774342151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc5c5e1f-953f-41e8-a126-d11c20bec34e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7fee074c694d51b8bc0f7e906a5c15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:19Z,use_quota=True,user_id='e9d9d382133d4aa59333317799ac586a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:28:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Creating volume cc5c5e1f-953f-41e8-a126-d11c20bec34e {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:28:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:28:23 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:28:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cc5c5e1f-953f-41e8-a126-d11c20bec34e 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1fd9f03-98ca-4cd3-8880-ff3bc19db302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e3631d4-26aa-4d97-a719-ff42d6226f79', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1535b7ce-3e94-4271-b41b-8cc87af629b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:23 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cc5c5e1f-953f-41e8-a126-d11c20bec34e 1073741824 Jul 08 01:28:23 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:23 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Volume volume-8e3631d4-26aa-4d97-a719-ff42d6226f79 (8e3631d4-26aa-4d97-a719-ff42d6226f79): created successfully Jul 08 01:28:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1535b7ce-3e94-4271-b41b-8cc87af629b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Flow 'volume_create_manager' (b8888c02-0b17-4ec3-89f0-1460ea5e18d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:23 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-442d9d30-425e-45e4-929c-4b459c5f61b7 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Created volume successfully. Jul 08 01:28:23 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ecc6fcd9-634e-4ed0-b0a1-38971ea9aee3 tempest-VolumeDependencyTests-1880504022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e06158b2-cc7d-400d-8053-8a154add9926" returned: 0 in 1.006s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ecc6fcd9-634e-4ed0-b0a1-38971ea9aee3 tempest-VolumeDependencyTests-1880504022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e06158b2-cc7d-400d-8053-8a154add9926 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:23 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e06158b2-cc7d-400d-8053-8a154add9926 Jul 08 01:28:23 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:24 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cc5c5e1f-953f-41e8-a126-d11c20bec34e 1073741824" returned: 0 in 0.834s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:24 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ecc6fcd9-634e-4ed0-b0a1-38971ea9aee3 tempest-VolumeDependencyTests-1880504022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e06158b2-cc7d-400d-8053-8a154add9926" returned: 0 in 0.737s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cc5c5e1f-953f-41e8-a126-d11c20bec34e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ecc6fcd9-634e-4ed0-b0a1-38971ea9aee3 tempest-VolumeDependencyTests-1880504022 None] Lock "cinder-quobyte-e06158b2-cc7d-400d-8053-8a154add9926" released by "delete_volume" :: held 1.798s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:24 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cc5c5e1f-953f-41e8-a126-d11c20bec34e Jul 08 01:28:24 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:24 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-ecc6fcd9-634e-4ed0-b0a1-38971ea9aee3 tempest-VolumeDependencyTests-1880504022 None] Created reservations ['1098b874-9afb-4981-a574-a94cddc2ddf7', '27085e10-e558-43c9-8219-dfe112ef6f85', '0b6a5206-4925-4760-a674-d29b031e41c4', '828f196c-e186-4bbd-a5c2-512434ec2d75'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ecc6fcd9-634e-4ed0-b0a1-38971ea9aee3 tempest-VolumeDependencyTests-1880504022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ecc6fcd9-634e-4ed0-b0a1-38971ea9aee3 tempest-VolumeDependencyTests-1880504022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ecc6fcd9-634e-4ed0-b0a1-38971ea9aee3 tempest-VolumeDependencyTests-1880504022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ecc6fcd9-634e-4ed0-b0a1-38971ea9aee3 tempest-VolumeDependencyTests-1880504022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ecc6fcd9-634e-4ed0-b0a1-38971ea9aee3 tempest-VolumeDependencyTests-1880504022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ecc6fcd9-634e-4ed0-b0a1-38971ea9aee3 tempest-VolumeDependencyTests-1880504022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:24 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:28:24 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:25 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cc5c5e1f-953f-41e8-a126-d11c20bec34e" returned: 0 in 0.707s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:28:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.993s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-381197518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd3f483-0642-433f-a22d-80e9136c1180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f452df384f48eb83e90aada847912b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:20Z,use_quota=True,user_id='b30345ecbc75478bb89b7973fce27193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:28:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Creating volume 6bd3f483-0642-433f-a22d-80e9136c1180 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:28:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:28:25 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:28:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6bd3f483-0642-433f-a22d-80e9136c1180 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:25 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6bd3f483-0642-433f-a22d-80e9136c1180 1073741824 Jul 08 01:28:25 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ca5695-18fd-4081-b757-b96303522cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc5c5e1f-953f-41e8-a126-d11c20bec34e', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8725715c-969e-42bf-842b-b2d4e85d97fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:25 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Volume volume-cc5c5e1f-953f-41e8-a126-d11c20bec34e (cc5c5e1f-953f-41e8-a126-d11c20bec34e): created successfully Jul 08 01:28:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8725715c-969e-42bf-842b-b2d4e85d97fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Flow 'volume_create_manager' (efd2c52b-4c42-4ab3-80af-619aef5c020e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:25 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-4c53fe4f-77c8-47c4-ba34-ebd816efab4c tempest-ProjectReaderTests-1850597384 None] Created volume successfully. Jul 08 01:28:25 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ecc6fcd9-634e-4ed0-b0a1-38971ea9aee3 tempest-VolumeDependencyTests-1880504022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.745s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:25 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-ecc6fcd9-634e-4ed0-b0a1-38971ea9aee3 tempest-VolumeDependencyTests-1880504022 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:25 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-ecc6fcd9-634e-4ed0-b0a1-38971ea9aee3 tempest-VolumeDependencyTests-1880504022 None] Deleted volume successfully. Jul 08 01:28:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ecc6fcd9-634e-4ed0-b0a1-38971ea9aee3 tempest-VolumeDependencyTests-1880504022 None] Lock "cinder-e06158b2-cc7d-400d-8053-8a154add9926-delete_volume" released by "delete_volume" :: held 2.824s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-09ac8094-adf2-47f9-93b6-5f1c9d3c3379 tempest-ProjectReaderTests-1850597384 None] Acquiring lock "cinder-cc5c5e1f-953f-41e8-a126-d11c20bec34e-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-09ac8094-adf2-47f9-93b6-5f1c9d3c3379 tempest-ProjectReaderTests-1850597384 None] Lock "cinder-cc5c5e1f-953f-41e8-a126-d11c20bec34e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-09ac8094-adf2-47f9-93b6-5f1c9d3c3379 tempest-ProjectReaderTests-1850597384 None] Acquiring lock "cinder-quobyte-cc5c5e1f-953f-41e8-a126-d11c20bec34e" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-09ac8094-adf2-47f9-93b6-5f1c9d3c3379 tempest-ProjectReaderTests-1850597384 None] Lock "cinder-quobyte-cc5c5e1f-953f-41e8-a126-d11c20bec34e" acquired by "delete_volume" :: waited 0.020s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:25 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66a081a-fb08-4542-820e-4a2bc743f16f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-09ac8094-adf2-47f9-93b6-5f1c9d3c3379 tempest-ProjectReaderTests-1850597384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cc5c5e1f-953f-41e8-a126-d11c20bec34e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:26 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cc5c5e1f-953f-41e8-a126-d11c20bec34e Jul 08 01:28:26 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:26 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6bd3f483-0642-433f-a22d-80e9136c1180 1073741824" returned: 0 in 1.109s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6bd3f483-0642-433f-a22d-80e9136c1180 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:26 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6bd3f483-0642-433f-a22d-80e9136c1180 Jul 08 01:28:26 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:26 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-09ac8094-adf2-47f9-93b6-5f1c9d3c3379 tempest-ProjectReaderTests-1850597384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cc5c5e1f-953f-41e8-a126-d11c20bec34e" returned: 0 in 1.022s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-09ac8094-adf2-47f9-93b6-5f1c9d3c3379 tempest-ProjectReaderTests-1850597384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cc5c5e1f-953f-41e8-a126-d11c20bec34e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:26 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cc5c5e1f-953f-41e8-a126-d11c20bec34e Jul 08 01:28:26 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:27 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6bd3f483-0642-433f-a22d-80e9136c1180" returned: 0 in 0.892s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] <== create_volume: return (2057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:28:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.062s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1fcfdc84-97b0-438c-a0c6-5e72d4e474c7 tempest-ProjectReaderTests-531722253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.968s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-1fcfdc84-97b0-438c-a0c6-5e72d4e474c7 tempest-ProjectReaderTests-531722253 None] Creating offline snapshot cbd7d0d7-d1cf-41f7-b9b0-739bcd635318 of volume ee4379c4-c04c-4862-9b5f-d4f767c9dd0c {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:28:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee9c389-c9c3-4e08-bf93-dc22e10301fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bd3f483-0642-433f-a22d-80e9136c1180', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f515476d-7834-4988-afeb-514e1169c54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:27 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[9047d199-5b71-456f-ab9a-b5dca1725547]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1fcfdc84-97b0-438c-a0c6-5e72d4e474c7 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:27 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Volume volume-6bd3f483-0642-433f-a22d-80e9136c1180 (6bd3f483-0642-433f-a22d-80e9136c1180): created successfully Jul 08 01:28:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f515476d-7834-4988-afeb-514e1169c54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:27 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Flow 'volume_create_manager' (af77d10e-8b4f-402b-b408-bf4fb08238fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:27 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-6cd7e634-0975-463c-a6e6-05f7a21e2594 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Created volume successfully. Jul 08 01:28:27 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c Jul 08 01:28:27 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:27 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-09ac8094-adf2-47f9-93b6-5f1c9d3c3379 tempest-ProjectReaderTests-1850597384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-cc5c5e1f-953f-41e8-a126-d11c20bec34e" returned: 0 in 0.925s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-09ac8094-adf2-47f9-93b6-5f1c9d3c3379 tempest-ProjectReaderTests-1850597384 None] Lock "cinder-quobyte-cc5c5e1f-953f-41e8-a126-d11c20bec34e" released by "delete_volume" :: held 2.015s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:27 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-09ac8094-adf2-47f9-93b6-5f1c9d3c3379 tempest-ProjectReaderTests-1850597384 None] Created reservations ['7a6cea43-ef4c-43af-9794-5ffe580fa6f1', '794a7c0f-9ddd-4c13-8a76-fdec0ed2a819', 'b10ec511-8304-44b7-9931-f31848138835', '6508c0a9-7eef-4a67-a285-2bf5c8843628'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-09ac8094-adf2-47f9-93b6-5f1c9d3c3379 tempest-ProjectReaderTests-1850597384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-09ac8094-adf2-47f9-93b6-5f1c9d3c3379 tempest-ProjectReaderTests-1850597384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:28 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-09ac8094-adf2-47f9-93b6-5f1c9d3c3379 tempest-ProjectReaderTests-1850597384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:28 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-09ac8094-adf2-47f9-93b6-5f1c9d3c3379 tempest-ProjectReaderTests-1850597384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-09ac8094-adf2-47f9-93b6-5f1c9d3c3379 tempest-ProjectReaderTests-1850597384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-09ac8094-adf2-47f9-93b6-5f1c9d3c3379 tempest-ProjectReaderTests-1850597384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:28 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:28:28 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:28 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1fcfdc84-97b0-438c-a0c6-5e72d4e474c7 tempest-ProjectReaderTests-531722253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c" returned: 0 in 1.039s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1fcfdc84-97b0-438c-a0c6-5e72d4e474c7 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c.cbd7d0d7-d1cf-41f7-b9b0-739bcd635318 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:28 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c.cbd7d0d7-d1cf-41f7-b9b0-739bcd635318 1G Jul 08 01:28:28 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:28 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-09ac8094-adf2-47f9-93b6-5f1c9d3c3379 tempest-ProjectReaderTests-1850597384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.885s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:28 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-09ac8094-adf2-47f9-93b6-5f1c9d3c3379 tempest-ProjectReaderTests-1850597384 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:28 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-09ac8094-adf2-47f9-93b6-5f1c9d3c3379 tempest-ProjectReaderTests-1850597384 None] Deleted volume successfully. Jul 08 01:28:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-09ac8094-adf2-47f9-93b6-5f1c9d3c3379 tempest-ProjectReaderTests-1850597384 None] Lock "cinder-cc5c5e1f-953f-41e8-a126-d11c20bec34e-delete_volume" released by "delete_volume" :: held 3.212s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:29 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1fcfdc84-97b0-438c-a0c6-5e72d4e474c7 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c.cbd7d0d7-d1cf-41f7-b9b0-739bcd635318 1G" returned: 0 in 1.151s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1fcfdc84-97b0-438c-a0c6-5e72d4e474c7 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c.cbd7d0d7-d1cf-41f7-b9b0-739bcd635318 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:29 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c.cbd7d0d7-d1cf-41f7-b9b0-739bcd635318 Jul 08 01:28:29 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:29 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:28:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Flow 'volume_create_manager' (833514de-1881-426c-8a61-275287d3167b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f624986-7575-4f67-9167-55e685cac195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f624986-7575-4f67-9167-55e685cac195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-657687000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8286e4c0-dd02-4776-b67a-7d56783fbf7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7fee074c694d51b8bc0f7e906a5c15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:30Z,use_quota=True,user_id='e9d9d382133d4aa59333317799ac586a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ec5f7c-c45d-4ddb-bedb-85c171f071fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ec5f7c-c45d-4ddb-bedb-85c171f071fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d79198-184a-4022-bbdb-7aa155dcb1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d79198-184a-4022-bbdb-7aa155dcb1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8286e4c0-dd02-4776-b67a-7d56783fbf7e', 'volume_name': 'volume-8286e4c0-dd02-4776-b67a-7d56783fbf7e', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (467eeb56-5367-405c-a50d-6900c7c7a327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (467eeb56-5367-405c-a50d-6900c7c7a327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:29 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b71ca52-9074-4687-8a35-68880288fec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:29 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Volume 8286e4c0-dd02-4776-b67a-7d56783fbf7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8286e4c0-dd02-4776-b67a-7d56783fbf7e', 'volume_size': 1} Jul 08 01:28:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:30 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1fcfdc84-97b0-438c-a0c6-5e72d4e474c7 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c.cbd7d0d7-d1cf-41f7-b9b0-739bcd635318" returned: 0 in 0.803s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:30 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-1fcfdc84-97b0-438c-a0c6-5e72d4e474c7 tempest-ProjectReaderTests-531722253 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c.cbd7d0d7-d1cf-41f7-b9b0-739bcd635318 is being set with open permissions: ugo+rw Jul 08 01:28:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1fcfdc84-97b0-438c-a0c6-5e72d4e474c7 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c.cbd7d0d7-d1cf-41f7-b9b0-739bcd635318 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:30 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c.cbd7d0d7-d1cf-41f7-b9b0-739bcd635318 Jul 08 01:28:30 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:30 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1fcfdc84-97b0-438c-a0c6-5e72d4e474c7 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c.cbd7d0d7-d1cf-41f7-b9b0-739bcd635318" returned: 0 in 0.683s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1fcfdc84-97b0-438c-a0c6-5e72d4e474c7 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:30 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c.info Jul 08 01:28:30 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:31 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1fcfdc84-97b0-438c-a0c6-5e72d4e474c7 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c.info" returned: 0 in 0.764s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:31 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-1fcfdc84-97b0-438c-a0c6-5e72d4e474c7 tempest-ProjectReaderTests-531722253 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c.info is being set with open permissions: ugo+rw Jul 08 01:28:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1fcfdc84-97b0-438c-a0c6-5e72d4e474c7 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:31 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c.info Jul 08 01:28:31 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:32 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1fcfdc84-97b0-438c-a0c6-5e72d4e474c7 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c.info" returned: 0 in 0.773s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1fcfdc84-97b0-438c-a0c6-5e72d4e474c7 tempest-ProjectReaderTests-531722253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.328s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.714s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:32 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2029017897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e330a1d-6ecc-49cd-b137-08e619b70f5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f452df384f48eb83e90aada847912b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:21Z,use_quota=True,user_id='b30345ecbc75478bb89b7973fce27193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:28:32 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Creating volume 1e330a1d-6ecc-49cd-b137-08e619b70f5a {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:28:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:32 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:32 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:32 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:28:32 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:28:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1e330a1d-6ecc-49cd-b137-08e619b70f5a 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:32 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1e330a1d-6ecc-49cd-b137-08e619b70f5a 1073741824 Jul 08 01:28:32 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:32 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-1fcfdc84-97b0-438c-a0c6-5e72d4e474c7 tempest-ProjectReaderTests-531722253 None] Create snapshot completed successfully Jul 08 01:28:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4a4dc5c5-dc16-4620-865f-820c11505101 tempest-ProjectReaderTests-531722253 None] Acquiring lock "cinder-cbd7d0d7-d1cf-41f7-b9b0-739bcd635318-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4a4dc5c5-dc16-4620-865f-820c11505101 tempest-ProjectReaderTests-531722253 None] Lock "cinder-cbd7d0d7-d1cf-41f7-b9b0-739bcd635318-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4a4dc5c5-dc16-4620-865f-820c11505101 tempest-ProjectReaderTests-531722253 None] Acquiring lock "cinder-quobyte-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4a4dc5c5-dc16-4620-865f-820c11505101 tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4a4dc5c5-dc16-4620-865f-820c11505101 tempest-ProjectReaderTests-531722253 None] Acquiring lock "cinder-quobyte-cbd7d0d7-d1cf-41f7-b9b0-739bcd635318" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4a4dc5c5-dc16-4620-865f-820c11505101 tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-cbd7d0d7-d1cf-41f7-b9b0-739bcd635318" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:33 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-4a4dc5c5-dc16-4620-865f-820c11505101 tempest-ProjectReaderTests-531722253 None] Deleting offline snapshot cbd7d0d7-d1cf-41f7-b9b0-739bcd635318 of volume ee4379c4-c04c-4862-9b5f-d4f767c9dd0c {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:28:33 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-4a4dc5c5-dc16-4620-865f-820c11505101 tempest-ProjectReaderTests-531722253 None] snapshot_file for this snap is: volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c.cbd7d0d7-d1cf-41f7-b9b0-739bcd635318 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:28:33 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[03059890-0004-49d4-a505-54d4181bfc88]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4a4dc5c5-dc16-4620-865f-820c11505101 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c.cbd7d0d7-d1cf-41f7-b9b0-739bcd635318 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:33 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c.cbd7d0d7-d1cf-41f7-b9b0-739bcd635318 Jul 08 01:28:33 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:33 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1e330a1d-6ecc-49cd-b137-08e619b70f5a 1073741824" returned: 0 in 1.083s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1e330a1d-6ecc-49cd-b137-08e619b70f5a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:33 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1e330a1d-6ecc-49cd-b137-08e619b70f5a Jul 08 01:28:33 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:34 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4a4dc5c5-dc16-4620-865f-820c11505101 tempest-ProjectReaderTests-531722253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c.cbd7d0d7-d1cf-41f7-b9b0-739bcd635318" returned: 0 in 0.991s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:34 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-4a4dc5c5-dc16-4620-865f-820c11505101 tempest-ProjectReaderTests-531722253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:28:34 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd8943d-5bd9-4126-a150-961757c80c39]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4a4dc5c5-dc16-4620-865f-820c11505101 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:34 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1e330a1d-6ecc-49cd-b137-08e619b70f5a" returned: 0 in 0.816s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:34 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:28:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.249s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:34 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1887892611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=890331ac-4f2d-40fd-840d-788ef34773b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f452df384f48eb83e90aada847912b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:21Z,use_quota=True,user_id='b30345ecbc75478bb89b7973fce27193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:28:34 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Creating volume 890331ac-4f2d-40fd-840d-788ef34773b1 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:28:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:34 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:34 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:34 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:28:34 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:28:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-890331ac-4f2d-40fd-840d-788ef34773b1 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:34 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2bc26d-75a3-414b-a1c1-9c23dc87059a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e330a1d-6ecc-49cd-b137-08e619b70f5a', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:34 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de10d0fb-b979-4699-b489-73bf2967a1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:34 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-890331ac-4f2d-40fd-840d-788ef34773b1 1073741824 Jul 08 01:28:34 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:34 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Volume volume-1e330a1d-6ecc-49cd-b137-08e619b70f5a (1e330a1d-6ecc-49cd-b137-08e619b70f5a): created successfully Jul 08 01:28:34 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de10d0fb-b979-4699-b489-73bf2967a1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:34 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Flow 'volume_create_manager' (c66a01c4-76e3-4a44-a6f4-5b937db5c564) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:34 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c Jul 08 01:28:34 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:34 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-c1a0485b-c04a-48d7-bc26-7f1c55e2104f tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Created volume successfully. Jul 08 01:28:35 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:28:35 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Flow 'volume_create_manager' (2a0accdf-5de7-4ab0-a575-dfd8486c5f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:35 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a6000ce-5aaa-44c5-a279-ae9868650a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:35 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a6000ce-5aaa-44c5-a279-ae9868650a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-159798440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e818188e-0f28-4ebe-8068-318fe2c59165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043a2938932846aa9a07c898bce15405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:35Z,use_quota=True,user_id='a3976431e3344a96ad536addcf6110bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:35 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e639c34e-6af1-4935-9beb-e149221b9a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:35 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e639c34e-6af1-4935-9beb-e149221b9a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:35 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f4a44f-a030-4022-b167-3cb64043f580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:35 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f4a44f-a030-4022-b167-3cb64043f580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e818188e-0f28-4ebe-8068-318fe2c59165', 'volume_name': 'volume-e818188e-0f28-4ebe-8068-318fe2c59165', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:35 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:35 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c399ad18-8b94-4a2e-85e5-8696ac665ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:35 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c399ad18-8b94-4a2e-85e5-8696ac665ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:35 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c2c76c-1dfb-42d4-ab39-156681a8ff0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:35 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Volume e818188e-0f28-4ebe-8068-318fe2c59165: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e818188e-0f28-4ebe-8068-318fe2c59165', 'volume_size': 1} Jul 08 01:28:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4a4dc5c5-dc16-4620-865f-820c11505101 tempest-ProjectReaderTests-531722253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c" returned: 0 in 1.198s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4a4dc5c5-dc16-4620-865f-820c11505101 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c.cbd7d0d7-d1cf-41f7-b9b0-739bcd635318 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:35 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c.cbd7d0d7-d1cf-41f7-b9b0-739bcd635318 Jul 08 01:28:35 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:35 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-890331ac-4f2d-40fd-840d-788ef34773b1 1073741824" returned: 0 in 1.224s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-890331ac-4f2d-40fd-840d-788ef34773b1 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:35 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-890331ac-4f2d-40fd-840d-788ef34773b1 Jul 08 01:28:35 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:36 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4a4dc5c5-dc16-4620-865f-820c11505101 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c.cbd7d0d7-d1cf-41f7-b9b0-739bcd635318" returned: 0 in 0.892s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4a4dc5c5-dc16-4620-865f-820c11505101 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c.cbd7d0d7-d1cf-41f7-b9b0-739bcd635318 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:36 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c.cbd7d0d7-d1cf-41f7-b9b0-739bcd635318 Jul 08 01:28:36 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:36 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-890331ac-4f2d-40fd-840d-788ef34773b1" returned: 0 in 0.798s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] <== create_volume: return (2076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:28:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.645s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-657687000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8286e4c0-dd02-4776-b67a-7d56783fbf7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7fee074c694d51b8bc0f7e906a5c15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:30Z,use_quota=True,user_id='e9d9d382133d4aa59333317799ac586a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:28:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Creating volume 8286e4c0-dd02-4776-b67a-7d56783fbf7e {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:28:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:28:36 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:28:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8286e4c0-dd02-4776-b67a-7d56783fbf7e 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:36 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8286e4c0-dd02-4776-b67a-7d56783fbf7e 1073741824 Jul 08 01:28:36 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0589ebf0-5bad-4591-ac05-2c344d061a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-890331ac-4f2d-40fd-840d-788ef34773b1', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4e7fc0-73a6-4a44-8a60-f60ada171027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:36 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Volume volume-890331ac-4f2d-40fd-840d-788ef34773b1 (890331ac-4f2d-40fd-840d-788ef34773b1): created successfully Jul 08 01:28:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4e7fc0-73a6-4a44-8a60-f60ada171027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Flow 'volume_create_manager' (63e6f60b-02ee-43a2-8a06-2c073d7a8fc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:36 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-ebdd97ad-ec40-4348-9242-aea283147d4a tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Created volume successfully. Jul 08 01:28:37 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4a4dc5c5-dc16-4620-865f-820c11505101 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c.cbd7d0d7-d1cf-41f7-b9b0-739bcd635318" returned: 0 in 0.809s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:37 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4a4dc5c5-dc16-4620-865f-820c11505101 tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-cbd7d0d7-d1cf-41f7-b9b0-739bcd635318" released by "_delete_snapshot" :: held 4.023s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:37 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4a4dc5c5-dc16-4620-865f-820c11505101 tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c" released by "delete_snapshot" :: held 4.057s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:37 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-4a4dc5c5-dc16-4620-865f-820c11505101 tempest-ProjectReaderTests-531722253 None] Created reservations ['0fd1a08c-a055-4181-81ba-742fe8b67bf8', '558bbf8c-ee02-41d0-8fe9-a731693e83ff', '6ac8afac-3807-427b-8b61-20680c7c1a5b', 'a70fdfb8-e9bb-41aa-a84a-5ba095840167'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:37 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-4a4dc5c5-dc16-4620-865f-820c11505101 tempest-ProjectReaderTests-531722253 None] Delete snapshot completed successfully. Jul 08 01:28:37 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4a4dc5c5-dc16-4620-865f-820c11505101 tempest-ProjectReaderTests-531722253 None] Lock "cinder-cbd7d0d7-d1cf-41f7-b9b0-739bcd635318-delete_snapshot" released by "delete_snapshot" :: held 4.301s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:37 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8286e4c0-dd02-4776-b67a-7d56783fbf7e 1073741824" returned: 0 in 1.051s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:37 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f88c084d-8d67-4540-913c-7484bbb70036 tempest-ProjectReaderTests-531722253 None] Acquiring lock "cinder-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:37 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f88c084d-8d67-4540-913c-7484bbb70036 tempest-ProjectReaderTests-531722253 None] Lock "cinder-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:37 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c328ff2f-6039-412e-8fec-25fced1c8d60 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "cinder-890331ac-4f2d-40fd-840d-788ef34773b1-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8286e4c0-dd02-4776-b67a-7d56783fbf7e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:37 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8286e4c0-dd02-4776-b67a-7d56783fbf7e Jul 08 01:28:37 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:37 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c328ff2f-6039-412e-8fec-25fced1c8d60 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "cinder-890331ac-4f2d-40fd-840d-788ef34773b1-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:37 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f88c084d-8d67-4540-913c-7484bbb70036 tempest-ProjectReaderTests-531722253 None] Acquiring lock "cinder-quobyte-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:37 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f88c084d-8d67-4540-913c-7484bbb70036 tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c" acquired by "delete_volume" :: waited 0.023s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:37 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c328ff2f-6039-412e-8fec-25fced1c8d60 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "cinder-quobyte-890331ac-4f2d-40fd-840d-788ef34773b1" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:37 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c23de86-5579-4b44-9090-6b39d33c1725]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f88c084d-8d67-4540-913c-7484bbb70036 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:37 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c328ff2f-6039-412e-8fec-25fced1c8d60 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "cinder-quobyte-890331ac-4f2d-40fd-840d-788ef34773b1" acquired by "delete_volume" :: waited 0.030s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:37 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d1cf3e-081d-4cbf-b2aa-e1b2558bb57e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c328ff2f-6039-412e-8fec-25fced1c8d60 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-890331ac-4f2d-40fd-840d-788ef34773b1 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:37 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c Jul 08 01:28:37 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:38 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-890331ac-4f2d-40fd-840d-788ef34773b1 Jul 08 01:28:38 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:38 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8286e4c0-dd02-4776-b67a-7d56783fbf7e" returned: 0 in 0.806s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] <== create_volume: return (1944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:28:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.948s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.894s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-159798440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e818188e-0f28-4ebe-8068-318fe2c59165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043a2938932846aa9a07c898bce15405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:35Z,use_quota=True,user_id='a3976431e3344a96ad536addcf6110bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:28:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Creating volume e818188e-0f28-4ebe-8068-318fe2c59165 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:28:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:28:38 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:28:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b71ca52-9074-4687-8a35-68880288fec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8286e4c0-dd02-4776-b67a-7d56783fbf7e', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c64856-4972-4916-b41d-66f85c416c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:38 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165 1073741824 Jul 08 01:28:38 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:38 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f88c084d-8d67-4540-913c-7484bbb70036 tempest-ProjectReaderTests-531722253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c" returned: 0 in 0.992s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f88c084d-8d67-4540-913c-7484bbb70036 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:38 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c328ff2f-6039-412e-8fec-25fced1c8d60 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-890331ac-4f2d-40fd-840d-788ef34773b1" returned: 0 in 0.961s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c328ff2f-6039-412e-8fec-25fced1c8d60 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-890331ac-4f2d-40fd-840d-788ef34773b1 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:38 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c Jul 08 01:28:38 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:38 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-890331ac-4f2d-40fd-840d-788ef34773b1 Jul 08 01:28:38 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:39 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Volume volume-8286e4c0-dd02-4776-b67a-7d56783fbf7e (8286e4c0-dd02-4776-b67a-7d56783fbf7e): created successfully Jul 08 01:28:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c64856-4972-4916-b41d-66f85c416c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:39 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Flow 'volume_create_manager' (833514de-1881-426c-8a61-275287d3167b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:39 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165 1073741824" returned: 0 in 1.180s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:39 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f88c084d-8d67-4540-913c-7484bbb70036 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c" returned: 0 in 0.892s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:39 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f88c084d-8d67-4540-913c-7484bbb70036 tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c" released by "delete_volume" :: held 1.967s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:39 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c328ff2f-6039-412e-8fec-25fced1c8d60 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-890331ac-4f2d-40fd-840d-788ef34773b1" returned: 0 in 0.939s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:39 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c328ff2f-6039-412e-8fec-25fced1c8d60 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "cinder-quobyte-890331ac-4f2d-40fd-840d-788ef34773b1" released by "delete_volume" :: held 1.962s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:40 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-d3bfbb05-46ec-4baf-9940-eb53accc2734 tempest-ProjectReaderTests-1850597384 None] Created volume successfully. Jul 08 01:28:40 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-c328ff2f-6039-412e-8fec-25fced1c8d60 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Created reservations ['0b6aff31-89da-4048-9adf-17bc5b9f1547', 'c976377e-3e8e-4231-93b2-e4652a38ebe7', '5bb565ac-22be-47b9-b56b-eefe0035ff8a', '74e236e4-150e-4225-8b05-4b09656a2fca'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:40 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-f88c084d-8d67-4540-913c-7484bbb70036 tempest-ProjectReaderTests-531722253 None] Created reservations ['4091867a-6848-4ec4-8fba-cf15f646641f', 'f3d74105-a0b8-439e-992a-1f4fc790f54b', 'b99b29f0-9a15-463a-a828-f3227885b8f2', '5acf2372-509e-4cc7-9fc6-6e831704cbf0'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-da3a3810-8545-4c44-958c-9a5e4ff825d0 tempest-ProjectReaderTests-1850597384 None] Acquiring lock "cinder-8286e4c0-dd02-4776-b67a-7d56783fbf7e-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-da3a3810-8545-4c44-958c-9a5e4ff825d0 tempest-ProjectReaderTests-1850597384 None] Lock "cinder-8286e4c0-dd02-4776-b67a-7d56783fbf7e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f88c084d-8d67-4540-913c-7484bbb70036 tempest-ProjectReaderTests-531722253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f88c084d-8d67-4540-913c-7484bbb70036 tempest-ProjectReaderTests-531722253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:42 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f88c084d-8d67-4540-913c-7484bbb70036 tempest-ProjectReaderTests-531722253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:42 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f88c084d-8d67-4540-913c-7484bbb70036 tempest-ProjectReaderTests-531722253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f88c084d-8d67-4540-913c-7484bbb70036 tempest-ProjectReaderTests-531722253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f88c084d-8d67-4540-913c-7484bbb70036 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:42 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165 Jul 08 01:28:42 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:42 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:28:42 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-da3a3810-8545-4c44-958c-9a5e4ff825d0 tempest-ProjectReaderTests-1850597384 None] Acquiring lock "cinder-quobyte-8286e4c0-dd02-4776-b67a-7d56783fbf7e" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-da3a3810-8545-4c44-958c-9a5e4ff825d0 tempest-ProjectReaderTests-1850597384 None] Lock "cinder-quobyte-8286e4c0-dd02-4776-b67a-7d56783fbf7e" acquired by "delete_volume" :: waited 0.022s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:42 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba29c43-4a6b-410c-a8f1-e9fb5ab703bd]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-da3a3810-8545-4c44-958c-9a5e4ff825d0 tempest-ProjectReaderTests-1850597384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8286e4c0-dd02-4776-b67a-7d56783fbf7e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c328ff2f-6039-412e-8fec-25fced1c8d60 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c328ff2f-6039-412e-8fec-25fced1c8d60 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:43 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c328ff2f-6039-412e-8fec-25fced1c8d60 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:43 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c328ff2f-6039-412e-8fec-25fced1c8d60 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c328ff2f-6039-412e-8fec-25fced1c8d60 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c328ff2f-6039-412e-8fec-25fced1c8d60 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:43 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8286e4c0-dd02-4776-b67a-7d56783fbf7e Jul 08 01:28:43 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:43 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:28:43 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:43 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f88c084d-8d67-4540-913c-7484bbb70036 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.940s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:43 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-f88c084d-8d67-4540-913c-7484bbb70036 tempest-ProjectReaderTests-531722253 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:43 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-f88c084d-8d67-4540-913c-7484bbb70036 tempest-ProjectReaderTests-531722253 None] Deleted volume successfully. Jul 08 01:28:43 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165" returned: 0 in 1.090s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:43 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] <== create_volume: return (5157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:28:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 5.162s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:43 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f88c084d-8d67-4540-913c-7484bbb70036 tempest-ProjectReaderTests-531722253 None] Lock "cinder-ee4379c4-c04c-4862-9b5f-d4f767c9dd0c-delete_volume" released by "delete_volume" :: held 6.242s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:43 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-da3a3810-8545-4c44-958c-9a5e4ff825d0 tempest-ProjectReaderTests-1850597384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8286e4c0-dd02-4776-b67a-7d56783fbf7e" returned: 0 in 1.029s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-da3a3810-8545-4c44-958c-9a5e4ff825d0 tempest-ProjectReaderTests-1850597384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8286e4c0-dd02-4776-b67a-7d56783fbf7e {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:43 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8286e4c0-dd02-4776-b67a-7d56783fbf7e Jul 08 01:28:43 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:44 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c328ff2f-6039-412e-8fec-25fced1c8d60 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.933s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-c328ff2f-6039-412e-8fec-25fced1c8d60 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:44 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-c328ff2f-6039-412e-8fec-25fced1c8d60 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Deleted volume successfully. Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c2c76c-1dfb-42d4-ab39-156681a8ff0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e818188e-0f28-4ebe-8068-318fe2c59165', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917a7b0c-8fe6-408d-a647-ca5f5097e6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-c328ff2f-6039-412e-8fec-25fced1c8d60 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "cinder-890331ac-4f2d-40fd-840d-788ef34773b1-delete_volume" released by "delete_volume" :: held 6.871s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:44 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-da3a3810-8545-4c44-958c-9a5e4ff825d0 tempest-ProjectReaderTests-1850597384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8286e4c0-dd02-4776-b67a-7d56783fbf7e" returned: 0 in 0.753s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-da3a3810-8545-4c44-958c-9a5e4ff825d0 tempest-ProjectReaderTests-1850597384 None] Lock "cinder-quobyte-8286e4c0-dd02-4776-b67a-7d56783fbf7e" released by "delete_volume" :: held 1.834s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:44 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Volume volume-e818188e-0f28-4ebe-8068-318fe2c59165 (e818188e-0f28-4ebe-8068-318fe2c59165): created successfully Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917a7b0c-8fe6-408d-a647-ca5f5097e6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Flow 'volume_create_manager' (2a0accdf-5de7-4ab0-a575-dfd8486c5f8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Flow 'volume_create_manager' (6a394433-3306-4b58-bdd3-e2e6e642e610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38bec9ef-1c09-4686-b7e3-8b9fa100833c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b11e4f05-52d2-4644-aaf6-742652a33fe9 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "cinder-1e330a1d-6ecc-49cd-b137-08e619b70f5a-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38bec9ef-1c09-4686-b7e3-8b9fa100833c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-883534033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f1221c-a78e-4ffd-b5ec-228a3a37daa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef33caddaf744243b8124f7dd8c4d1e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:44Z,use_quota=True,user_id='b01a5b33fd3a461a963e8aa3700add02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d504ab2-1d64-415f-8ba8-39b4bc3419b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d504ab2-1d64-415f-8ba8-39b4bc3419b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f42ffc4a-dcf3-4d43-87d4-5b10027c3314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f42ffc4a-dcf3-4d43-87d4-5b10027c3314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48f1221c-a78e-4ffd-b5ec-228a3a37daa6', 'volume_name': 'volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b69e50c9-9359-4467-b1a5-775486d15409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b69e50c9-9359-4467-b1a5-775486d15409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3345eb-5367-4eb9-b3b1-b036c14f4a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:44 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Volume 48f1221c-a78e-4ffd-b5ec-228a3a37daa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6', 'volume_size': 1} Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-883534033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f1221c-a78e-4ffd-b5ec-228a3a37daa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef33caddaf744243b8124f7dd8c4d1e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:44Z,use_quota=True,user_id='b01a5b33fd3a461a963e8aa3700add02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Creating volume 48f1221c-a78e-4ffd-b5ec-228a3a37daa6 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:28:44 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:44 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b11e4f05-52d2-4644-aaf6-742652a33fe9 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "cinder-1e330a1d-6ecc-49cd-b137-08e619b70f5a-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:44 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6 1073741824 Jul 08 01:28:44 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:45 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-da3a3810-8545-4c44-958c-9a5e4ff825d0 tempest-ProjectReaderTests-1850597384 None] Created reservations ['b4cca4e9-5916-412f-b75b-923b4740a411', 'cce5311b-77d5-47e8-a2aa-8c55538ee02b', 'efeac2aa-98a3-4744-ba6c-18c554bbced0', '4a40787c-72d5-4efd-8e41-c1f46cdbfb2e'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:45 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-8b3caa8d-4c73-4637-a644-43bb7a29def1 tempest-ProjectMemberTests-945597890 None] Created volume successfully. Jul 08 01:28:45 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b11e4f05-52d2-4644-aaf6-742652a33fe9 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "cinder-quobyte-1e330a1d-6ecc-49cd-b137-08e619b70f5a" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:45 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b11e4f05-52d2-4644-aaf6-742652a33fe9 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "cinder-quobyte-1e330a1d-6ecc-49cd-b137-08e619b70f5a" acquired by "delete_volume" :: waited 0.033s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:45 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a27bb0f-08a1-48c1-9c41-fad8297b4171]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b11e4f05-52d2-4644-aaf6-742652a33fe9 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1e330a1d-6ecc-49cd-b137-08e619b70f5a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-da3a3810-8545-4c44-958c-9a5e4ff825d0 tempest-ProjectReaderTests-1850597384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-da3a3810-8545-4c44-958c-9a5e4ff825d0 tempest-ProjectReaderTests-1850597384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-da3a3810-8545-4c44-958c-9a5e4ff825d0 tempest-ProjectReaderTests-1850597384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-da3a3810-8545-4c44-958c-9a5e4ff825d0 tempest-ProjectReaderTests-1850597384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-da3a3810-8545-4c44-958c-9a5e4ff825d0 tempest-ProjectReaderTests-1850597384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-da3a3810-8545-4c44-958c-9a5e4ff825d0 tempest-ProjectReaderTests-1850597384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:45 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:28:45 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:45 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1e330a1d-6ecc-49cd-b137-08e619b70f5a Jul 08 01:28:45 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:45 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:28:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:45 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:28:45 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:46 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6 1073741824" returned: 0 in 1.173s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:46 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6 Jul 08 01:28:46 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-270b3427-c147-474b-8600-196f010a1b62 tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:46 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b11e4f05-52d2-4644-aaf6-742652a33fe9 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1e330a1d-6ecc-49cd-b137-08e619b70f5a" returned: 0 in 1.219s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b11e4f05-52d2-4644-aaf6-742652a33fe9 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1e330a1d-6ecc-49cd-b137-08e619b70f5a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:46 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1e330a1d-6ecc-49cd-b137-08e619b70f5a Jul 08 01:28:46 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:46 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.092s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:46 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:46 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:28:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread count: 28 {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:28:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread info: [<_MainThread(MainThread, started 134382216167552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:28:46 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-da3a3810-8545-4c44-958c-9a5e4ff825d0 tempest-ProjectReaderTests-1850597384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 1.269s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:46 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-da3a3810-8545-4c44-958c-9a5e4ff825d0 tempest-ProjectReaderTests-1850597384 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:46 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-da3a3810-8545-4c44-958c-9a5e4ff825d0 tempest-ProjectReaderTests-1850597384 None] Deleted volume successfully. Jul 08 01:28:46 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-da3a3810-8545-4c44-958c-9a5e4ff825d0 tempest-ProjectReaderTests-1850597384 None] Lock "cinder-8286e4c0-dd02-4776-b67a-7d56783fbf7e-delete_volume" released by "delete_volume" :: held 4.319s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:47 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6" returned: 0 in 0.931s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:47 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] <== create_volume: return (2201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:28:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.203s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-270b3427-c147-474b-8600-196f010a1b62 tempest-ProjectMemberTests-945597890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.813s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:47 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3345eb-5367-4eb9-b3b1-b036c14f4a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:47 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa770dee-7378-45b4-adae-a72a6ff5d280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:47 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-270b3427-c147-474b-8600-196f010a1b62 tempest-ProjectMemberTests-945597890 None] Creating offline snapshot e1d3a98a-7936-4b03-b0a0-08b338df1798 of volume e818188e-0f28-4ebe-8068-318fe2c59165 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:28:47 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Volume volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6 (48f1221c-a78e-4ffd-b5ec-228a3a37daa6): created successfully Jul 08 01:28:47 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa770dee-7378-45b4-adae-a72a6ff5d280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:47 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Flow 'volume_create_manager' (6a394433-3306-4b58-bdd3-e2e6e642e610) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:47 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[69eac074-cd1e-42b4-8439-ca0252d78e46]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-270b3427-c147-474b-8600-196f010a1b62 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:47 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b11e4f05-52d2-4644-aaf6-742652a33fe9 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1e330a1d-6ecc-49cd-b137-08e619b70f5a" returned: 0 in 0.828s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:47 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-57bcd88a-cde3-48e9-9ce2-5b05fde46ece tempest-ProjectReaderTests-531722253 None] Created volume successfully. Jul 08 01:28:47 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b11e4f05-52d2-4644-aaf6-742652a33fe9 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "cinder-quobyte-1e330a1d-6ecc-49cd-b137-08e619b70f5a" released by "delete_volume" :: held 2.151s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:47 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165 Jul 08 01:28:47 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:47 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-b11e4f05-52d2-4644-aaf6-742652a33fe9 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Created reservations ['1275fc25-bf20-4df2-a498-345714501485', 'ab669665-781f-482b-912a-24f8e1c89bf4', 'f65210b0-268a-4411-bdf4-80c9e5e62143', '6b9c600f-0b7c-4425-b44e-69fc522947b5'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b11e4f05-52d2-4644-aaf6-742652a33fe9 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b11e4f05-52d2-4644-aaf6-742652a33fe9 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:47 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b11e4f05-52d2-4644-aaf6-742652a33fe9 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:47 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b11e4f05-52d2-4644-aaf6-742652a33fe9 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b11e4f05-52d2-4644-aaf6-742652a33fe9 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b11e4f05-52d2-4644-aaf6-742652a33fe9 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:47 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:28:47 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-52f6b78d-8d45-4f72-8acc-25fb75ad832d tempest-ProjectReaderTests-531722253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:48 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f7c25237-35f6-4c15-8bcb-bf556695727b tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "cinder-6bd3f483-0642-433f-a22d-80e9136c1180-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:48 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f7c25237-35f6-4c15-8bcb-bf556695727b tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "cinder-6bd3f483-0642-433f-a22d-80e9136c1180-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:48 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f7c25237-35f6-4c15-8bcb-bf556695727b tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "cinder-quobyte-6bd3f483-0642-433f-a22d-80e9136c1180" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:48 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:48 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f7c25237-35f6-4c15-8bcb-bf556695727b tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "cinder-quobyte-6bd3f483-0642-433f-a22d-80e9136c1180" acquired by "delete_volume" :: waited 0.030s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-270b3427-c147-474b-8600-196f010a1b62 tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165" returned: 0 in 1.189s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-270b3427-c147-474b-8600-196f010a1b62 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165.e1d3a98a-7936-4b03-b0a0-08b338df1798 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:48 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7580e49d-2e95-44fa-8cfa-95b8bc44affb]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f7c25237-35f6-4c15-8bcb-bf556695727b tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6bd3f483-0642-433f-a22d-80e9136c1180 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:48 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165.e1d3a98a-7936-4b03-b0a0-08b338df1798 1G Jul 08 01:28:48 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:48 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b11e4f05-52d2-4644-aaf6-742652a33fe9 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.911s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:48 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-b11e4f05-52d2-4644-aaf6-742652a33fe9 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:48 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-b11e4f05-52d2-4644-aaf6-742652a33fe9 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Deleted volume successfully. Jul 08 01:28:48 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b11e4f05-52d2-4644-aaf6-742652a33fe9 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "cinder-1e330a1d-6ecc-49cd-b137-08e619b70f5a-delete_volume" released by "delete_volume" :: held 3.604s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:48 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6bd3f483-0642-433f-a22d-80e9136c1180 Jul 08 01:28:48 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:49 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-270b3427-c147-474b-8600-196f010a1b62 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165.e1d3a98a-7936-4b03-b0a0-08b338df1798 1G" returned: 0 in 0.896s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-270b3427-c147-474b-8600-196f010a1b62 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e818188e-0f28-4ebe-8068-318fe2c59165 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165.e1d3a98a-7936-4b03-b0a0-08b338df1798 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:49 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e818188e-0f28-4ebe-8068-318fe2c59165 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165.e1d3a98a-7936-4b03-b0a0-08b338df1798 Jul 08 01:28:49 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:49 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f7c25237-35f6-4c15-8bcb-bf556695727b tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6bd3f483-0642-433f-a22d-80e9136c1180" returned: 0 in 1.028s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f7c25237-35f6-4c15-8bcb-bf556695727b tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6bd3f483-0642-433f-a22d-80e9136c1180 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:49 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6bd3f483-0642-433f-a22d-80e9136c1180 Jul 08 01:28:49 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:50 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-270b3427-c147-474b-8600-196f010a1b62 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e818188e-0f28-4ebe-8068-318fe2c59165 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165.e1d3a98a-7936-4b03-b0a0-08b338df1798" returned: 0 in 0.782s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:50 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-270b3427-c147-474b-8600-196f010a1b62 tempest-ProjectMemberTests-945597890 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165.e1d3a98a-7936-4b03-b0a0-08b338df1798 is being set with open permissions: ugo+rw Jul 08 01:28:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-270b3427-c147-474b-8600-196f010a1b62 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165.e1d3a98a-7936-4b03-b0a0-08b338df1798 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:50 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165.e1d3a98a-7936-4b03-b0a0-08b338df1798 Jul 08 01:28:50 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:50 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f7c25237-35f6-4c15-8bcb-bf556695727b tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-6bd3f483-0642-433f-a22d-80e9136c1180" returned: 0 in 0.778s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f7c25237-35f6-4c15-8bcb-bf556695727b tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "cinder-quobyte-6bd3f483-0642-433f-a22d-80e9136c1180" released by "delete_volume" :: held 1.869s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:50 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-f7c25237-35f6-4c15-8bcb-bf556695727b tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Created reservations ['087bb030-fa6e-4270-b1ee-ab8cfff63967', '1bfc9bb9-9d4c-4c03-a1b5-bc8defb20936', '6e681803-8830-4951-9364-c16b6b00a52d', 'fb0ea24e-3f87-44d5-822c-2135edf0fa01'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f7c25237-35f6-4c15-8bcb-bf556695727b tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f7c25237-35f6-4c15-8bcb-bf556695727b tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:50 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f7c25237-35f6-4c15-8bcb-bf556695727b tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:50 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-f7c25237-35f6-4c15-8bcb-bf556695727b tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-f7c25237-35f6-4c15-8bcb-bf556695727b tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f7c25237-35f6-4c15-8bcb-bf556695727b tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:50 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:28:50 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-413f82a6-58ac-4c93-8cd6-64a5807f38e4 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "cinder-8e3631d4-26aa-4d97-a719-ff42d6226f79-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-413f82a6-58ac-4c93-8cd6-64a5807f38e4 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "cinder-8e3631d4-26aa-4d97-a719-ff42d6226f79-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-413f82a6-58ac-4c93-8cd6-64a5807f38e4 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "cinder-quobyte-8e3631d4-26aa-4d97-a719-ff42d6226f79" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-413f82a6-58ac-4c93-8cd6-64a5807f38e4 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "cinder-quobyte-8e3631d4-26aa-4d97-a719-ff42d6226f79" acquired by "delete_volume" :: waited 0.019s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:50 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f62cc77-6d53-4083-9857-7d98d52d169b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-413f82a6-58ac-4c93-8cd6-64a5807f38e4 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8e3631d4-26aa-4d97-a719-ff42d6226f79 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:50 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-270b3427-c147-474b-8600-196f010a1b62 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165.e1d3a98a-7936-4b03-b0a0-08b338df1798" returned: 0 in 0.720s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:50 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8e3631d4-26aa-4d97-a719-ff42d6226f79 Jul 08 01:28:50 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-270b3427-c147-474b-8600-196f010a1b62 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:50 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165.info Jul 08 01:28:50 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:51 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f7c25237-35f6-4c15-8bcb-bf556695727b tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.747s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:51 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-f7c25237-35f6-4c15-8bcb-bf556695727b tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:51 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-f7c25237-35f6-4c15-8bcb-bf556695727b tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Deleted volume successfully. Jul 08 01:28:51 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f7c25237-35f6-4c15-8bcb-bf556695727b tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "cinder-6bd3f483-0642-433f-a22d-80e9136c1180-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:51 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-413f82a6-58ac-4c93-8cd6-64a5807f38e4 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8e3631d4-26aa-4d97-a719-ff42d6226f79" returned: 0 in 0.828s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-413f82a6-58ac-4c93-8cd6-64a5807f38e4 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8e3631d4-26aa-4d97-a719-ff42d6226f79 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:51 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8e3631d4-26aa-4d97-a719-ff42d6226f79 Jul 08 01:28:51 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:51 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-270b3427-c147-474b-8600-196f010a1b62 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165.info" returned: 0 in 0.806s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:51 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-270b3427-c147-474b-8600-196f010a1b62 tempest-ProjectMemberTests-945597890 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165.info is being set with open permissions: ugo+rw Jul 08 01:28:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-270b3427-c147-474b-8600-196f010a1b62 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:51 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165.info Jul 08 01:28:51 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:52 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-413f82a6-58ac-4c93-8cd6-64a5807f38e4 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8e3631d4-26aa-4d97-a719-ff42d6226f79" returned: 0 in 0.751s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:52 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-413f82a6-58ac-4c93-8cd6-64a5807f38e4 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "cinder-quobyte-8e3631d4-26aa-4d97-a719-ff42d6226f79" released by "delete_volume" :: held 1.648s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:52 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-413f82a6-58ac-4c93-8cd6-64a5807f38e4 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Created reservations ['4c79e818-e102-43d1-9ae0-fc93f965a6be', 'c7f92810-30d3-411b-8a1e-3aacf2534b5d', '8bc3d5d8-836d-4778-b1cd-d849464098a1', 'dcb6e525-c60c-4b16-8d23-a2e8e08c6496'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-413f82a6-58ac-4c93-8cd6-64a5807f38e4 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-413f82a6-58ac-4c93-8cd6-64a5807f38e4 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:52 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-413f82a6-58ac-4c93-8cd6-64a5807f38e4 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-413f82a6-58ac-4c93-8cd6-64a5807f38e4 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-413f82a6-58ac-4c93-8cd6-64a5807f38e4 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-413f82a6-58ac-4c93-8cd6-64a5807f38e4 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-270b3427-c147-474b-8600-196f010a1b62 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165.info" returned: 0 in 0.788s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-270b3427-c147-474b-8600-196f010a1b62 tempest-ProjectMemberTests-945597890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.342s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:52 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:28:52 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-52f6b78d-8d45-4f72-8acc-25fb75ad832d tempest-ProjectReaderTests-531722253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.366s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-52f6b78d-8d45-4f72-8acc-25fb75ad832d tempest-ProjectReaderTests-531722253 None] Creating offline snapshot 41d7bb95-3a77-4334-b403-435c3292a878 of volume 48f1221c-a78e-4ffd-b5ec-228a3a37daa6 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:28:52 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-270b3427-c147-474b-8600-196f010a1b62 tempest-ProjectMemberTests-945597890 None] Create snapshot completed successfully Jul 08 01:28:52 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[244dcacd-03ca-453a-ad6c-589d2a932875]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-52f6b78d-8d45-4f72-8acc-25fb75ad832d tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:52 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8c04f204-d155-4dba-b039-befd2be4dbed tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-e1d3a98a-7936-4b03-b0a0-08b338df1798-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:52 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8c04f204-d155-4dba-b039-befd2be4dbed tempest-ProjectMemberTests-945597890 None] Lock "cinder-e1d3a98a-7936-4b03-b0a0-08b338df1798-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:52 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8c04f204-d155-4dba-b039-befd2be4dbed tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-quobyte-e818188e-0f28-4ebe-8068-318fe2c59165" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:52 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8c04f204-d155-4dba-b039-befd2be4dbed tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-e818188e-0f28-4ebe-8068-318fe2c59165" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:52 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8c04f204-d155-4dba-b039-befd2be4dbed tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-quobyte-e1d3a98a-7936-4b03-b0a0-08b338df1798" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:52 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8c04f204-d155-4dba-b039-befd2be4dbed tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-e1d3a98a-7936-4b03-b0a0-08b338df1798" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:52 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6 Jul 08 01:28:52 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-8c04f204-d155-4dba-b039-befd2be4dbed tempest-ProjectMemberTests-945597890 None] Deleting offline snapshot e1d3a98a-7936-4b03-b0a0-08b338df1798 of volume e818188e-0f28-4ebe-8068-318fe2c59165 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:28:52 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-8c04f204-d155-4dba-b039-befd2be4dbed tempest-ProjectMemberTests-945597890 None] snapshot_file for this snap is: volume-e818188e-0f28-4ebe-8068-318fe2c59165.e1d3a98a-7936-4b03-b0a0-08b338df1798 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:28:52 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fa9113-d88b-4508-aff6-3cf1e2776c57]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8c04f204-d155-4dba-b039-befd2be4dbed tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165.e1d3a98a-7936-4b03-b0a0-08b338df1798 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:52 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-59533554-884a-4046-aa25-839b72d4a2cd tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "cinder-fe1fb4e1-9948-4bf6-9ea1-af2ba6841adb-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:52 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-59533554-884a-4046-aa25-839b72d4a2cd tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "cinder-fe1fb4e1-9948-4bf6-9ea1-af2ba6841adb-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:52 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165.e1d3a98a-7936-4b03-b0a0-08b338df1798 Jul 08 01:28:52 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:52 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-59533554-884a-4046-aa25-839b72d4a2cd tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "cinder-quobyte-fe1fb4e1-9948-4bf6-9ea1-af2ba6841adb" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:53 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-59533554-884a-4046-aa25-839b72d4a2cd tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "cinder-quobyte-fe1fb4e1-9948-4bf6-9ea1-af2ba6841adb" acquired by "delete_volume" :: waited 0.033s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:53 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d89bcc-8f50-4731-93a2-da2aa0672539]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-59533554-884a-4046-aa25-839b72d4a2cd tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fe1fb4e1-9948-4bf6-9ea1-af2ba6841adb {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:53 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fe1fb4e1-9948-4bf6-9ea1-af2ba6841adb Jul 08 01:28:53 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:53 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-413f82a6-58ac-4c93-8cd6-64a5807f38e4 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.905s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:53 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-413f82a6-58ac-4c93-8cd6-64a5807f38e4 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:53 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-413f82a6-58ac-4c93-8cd6-64a5807f38e4 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Deleted volume successfully. Jul 08 01:28:53 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-413f82a6-58ac-4c93-8cd6-64a5807f38e4 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "cinder-8e3631d4-26aa-4d97-a719-ff42d6226f79-delete_volume" released by "delete_volume" :: held 2.810s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:53 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-52f6b78d-8d45-4f72-8acc-25fb75ad832d tempest-ProjectReaderTests-531722253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6" returned: 0 in 0.998s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-52f6b78d-8d45-4f72-8acc-25fb75ad832d tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6.41d7bb95-3a77-4334-b403-435c3292a878 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:53 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6.41d7bb95-3a77-4334-b403-435c3292a878 1G Jul 08 01:28:53 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:53 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8c04f204-d155-4dba-b039-befd2be4dbed tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165.e1d3a98a-7936-4b03-b0a0-08b338df1798" returned: 0 in 0.889s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:53 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-8c04f204-d155-4dba-b039-befd2be4dbed tempest-ProjectMemberTests-945597890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e818188e-0f28-4ebe-8068-318fe2c59165(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:28:53 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[394dfc60-9b6f-4ad6-b986-b38b80525c46]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8c04f204-d155-4dba-b039-befd2be4dbed tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:53 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165 Jul 08 01:28:53 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:54 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-59533554-884a-4046-aa25-839b72d4a2cd tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fe1fb4e1-9948-4bf6-9ea1-af2ba6841adb" returned: 0 in 1.046s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-59533554-884a-4046-aa25-839b72d4a2cd tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fe1fb4e1-9948-4bf6-9ea1-af2ba6841adb {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:54 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fe1fb4e1-9948-4bf6-9ea1-af2ba6841adb Jul 08 01:28:54 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:54 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-52f6b78d-8d45-4f72-8acc-25fb75ad832d tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6.41d7bb95-3a77-4334-b403-435c3292a878 1G" returned: 0 in 0.913s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-52f6b78d-8d45-4f72-8acc-25fb75ad832d tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6.41d7bb95-3a77-4334-b403-435c3292a878 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:54 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6.41d7bb95-3a77-4334-b403-435c3292a878 Jul 08 01:28:54 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:54 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8c04f204-d155-4dba-b039-befd2be4dbed tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165" returned: 0 in 0.907s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8c04f204-d155-4dba-b039-befd2be4dbed tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165.e1d3a98a-7936-4b03-b0a0-08b338df1798 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:54 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165.e1d3a98a-7936-4b03-b0a0-08b338df1798 Jul 08 01:28:54 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:54 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-59533554-884a-4046-aa25-839b72d4a2cd tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-fe1fb4e1-9948-4bf6-9ea1-af2ba6841adb" returned: 0 in 0.832s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:54 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-59533554-884a-4046-aa25-839b72d4a2cd tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "cinder-quobyte-fe1fb4e1-9948-4bf6-9ea1-af2ba6841adb" released by "delete_volume" :: held 1.936s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:54 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-59533554-884a-4046-aa25-839b72d4a2cd tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Created reservations ['e22b6893-35ac-4063-9150-232353a7a8da', '47709d05-1830-4d92-8a39-b13dd3799056', '4259b402-bc46-4bb9-bb03-acab3fba7734', '324f8589-41c2-4687-bb64-6c188799bdec'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-59533554-884a-4046-aa25-839b72d4a2cd tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-59533554-884a-4046-aa25-839b72d4a2cd tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:55 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-59533554-884a-4046-aa25-839b72d4a2cd tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:55 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-59533554-884a-4046-aa25-839b72d4a2cd tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-59533554-884a-4046-aa25-839b72d4a2cd tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-59533554-884a-4046-aa25-839b72d4a2cd tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:55 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:28:55 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:55 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-396f97ba-1eaf-4a82-974a-8f0b0ba37683 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "cinder-a8a32532-1071-48cd-90a3-a5ada3b18fa4-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:55 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-396f97ba-1eaf-4a82-974a-8f0b0ba37683 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "cinder-a8a32532-1071-48cd-90a3-a5ada3b18fa4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:55 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-396f97ba-1eaf-4a82-974a-8f0b0ba37683 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "cinder-quobyte-a8a32532-1071-48cd-90a3-a5ada3b18fa4" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:55 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-396f97ba-1eaf-4a82-974a-8f0b0ba37683 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "cinder-quobyte-a8a32532-1071-48cd-90a3-a5ada3b18fa4" acquired by "delete_volume" :: waited 0.034s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:55 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae767fa4-5d3c-4af7-b3c0-49d5c195dfec]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-396f97ba-1eaf-4a82-974a-8f0b0ba37683 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a8a32532-1071-48cd-90a3-a5ada3b18fa4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:55 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-52f6b78d-8d45-4f72-8acc-25fb75ad832d tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6.41d7bb95-3a77-4334-b403-435c3292a878" returned: 0 in 0.998s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:55 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-52f6b78d-8d45-4f72-8acc-25fb75ad832d tempest-ProjectReaderTests-531722253 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6.41d7bb95-3a77-4334-b403-435c3292a878 is being set with open permissions: ugo+rw Jul 08 01:28:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-52f6b78d-8d45-4f72-8acc-25fb75ad832d tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6.41d7bb95-3a77-4334-b403-435c3292a878 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:55 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8c04f204-d155-4dba-b039-befd2be4dbed tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165.e1d3a98a-7936-4b03-b0a0-08b338df1798" returned: 0 in 0.863s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8c04f204-d155-4dba-b039-befd2be4dbed tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165.e1d3a98a-7936-4b03-b0a0-08b338df1798 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:55 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6.41d7bb95-3a77-4334-b403-435c3292a878 Jul 08 01:28:55 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:55 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165.e1d3a98a-7936-4b03-b0a0-08b338df1798 Jul 08 01:28:55 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:55 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a8a32532-1071-48cd-90a3-a5ada3b18fa4 Jul 08 01:28:55 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:56 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-59533554-884a-4046-aa25-839b72d4a2cd tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.986s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:56 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-59533554-884a-4046-aa25-839b72d4a2cd tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:56 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-59533554-884a-4046-aa25-839b72d4a2cd tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Deleted volume successfully. Jul 08 01:28:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-59533554-884a-4046-aa25-839b72d4a2cd tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "cinder-fe1fb4e1-9948-4bf6-9ea1-af2ba6841adb-delete_volume" released by "delete_volume" :: held 3.256s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:56 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-52f6b78d-8d45-4f72-8acc-25fb75ad832d tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6.41d7bb95-3a77-4334-b403-435c3292a878" returned: 0 in 0.724s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-52f6b78d-8d45-4f72-8acc-25fb75ad832d tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:56 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6.info Jul 08 01:28:56 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:56 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8c04f204-d155-4dba-b039-befd2be4dbed tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165.e1d3a98a-7936-4b03-b0a0-08b338df1798" returned: 0 in 0.853s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8c04f204-d155-4dba-b039-befd2be4dbed tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-e1d3a98a-7936-4b03-b0a0-08b338df1798" released by "_delete_snapshot" :: held 3.699s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8c04f204-d155-4dba-b039-befd2be4dbed tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-e818188e-0f28-4ebe-8068-318fe2c59165" released by "delete_snapshot" :: held 3.728s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:56 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-396f97ba-1eaf-4a82-974a-8f0b0ba37683 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a8a32532-1071-48cd-90a3-a5ada3b18fa4" returned: 0 in 1.017s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-396f97ba-1eaf-4a82-974a-8f0b0ba37683 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a8a32532-1071-48cd-90a3-a5ada3b18fa4 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:56 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a8a32532-1071-48cd-90a3-a5ada3b18fa4 Jul 08 01:28:56 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:56 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-8c04f204-d155-4dba-b039-befd2be4dbed tempest-ProjectMemberTests-945597890 None] Created reservations ['2e338e70-5da1-4476-a6ad-0402ba82b6ab', '8af6656e-74ef-4436-93c0-60a4d741ce5c', 'dd5ec9f8-d7d7-4675-be60-7ef04cfc0935', '03eed599-8203-467d-b043-6e71487619c4'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:56 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-8c04f204-d155-4dba-b039-befd2be4dbed tempest-ProjectMemberTests-945597890 None] Delete snapshot completed successfully. Jul 08 01:28:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8c04f204-d155-4dba-b039-befd2be4dbed tempest-ProjectMemberTests-945597890 None] Lock "cinder-e1d3a98a-7936-4b03-b0a0-08b338df1798-delete_snapshot" released by "delete_snapshot" :: held 3.932s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:56 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a5c16113-a7eb-4ea5-96fb-2b10395f3c36 tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-e818188e-0f28-4ebe-8068-318fe2c59165-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-52f6b78d-8d45-4f72-8acc-25fb75ad832d tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6.info" returned: 0 in 0.728s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:56 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-52f6b78d-8d45-4f72-8acc-25fb75ad832d tempest-ProjectReaderTests-531722253 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6.info is being set with open permissions: ugo+rw Jul 08 01:28:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-52f6b78d-8d45-4f72-8acc-25fb75ad832d tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a5c16113-a7eb-4ea5-96fb-2b10395f3c36 tempest-ProjectMemberTests-945597890 None] Lock "cinder-e818188e-0f28-4ebe-8068-318fe2c59165-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:56 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6.info Jul 08 01:28:56 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:57 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a5c16113-a7eb-4ea5-96fb-2b10395f3c36 tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-quobyte-e818188e-0f28-4ebe-8068-318fe2c59165" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:57 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a5c16113-a7eb-4ea5-96fb-2b10395f3c36 tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-e818188e-0f28-4ebe-8068-318fe2c59165" acquired by "delete_volume" :: waited 0.026s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:57 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cf696e-f1d1-4eb9-9e92-0b9fc138cba6]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a5c16113-a7eb-4ea5-96fb-2b10395f3c36 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:57 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165 Jul 08 01:28:57 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:57 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-396f97ba-1eaf-4a82-974a-8f0b0ba37683 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a8a32532-1071-48cd-90a3-a5ada3b18fa4" returned: 0 in 0.820s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:57 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-396f97ba-1eaf-4a82-974a-8f0b0ba37683 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "cinder-quobyte-a8a32532-1071-48cd-90a3-a5ada3b18fa4" released by "delete_volume" :: held 1.891s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:57 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-396f97ba-1eaf-4a82-974a-8f0b0ba37683 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Created reservations ['502394d2-74c0-4b98-9c7c-22850f5d51ef', 'b74a1701-8568-4573-a9cf-abb8061f4c36', 'ac722d7f-67a1-4246-afae-b539d2d03379', '51897913-1416-4ca2-af4a-f84ac28caae4'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-396f97ba-1eaf-4a82-974a-8f0b0ba37683 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-396f97ba-1eaf-4a82-974a-8f0b0ba37683 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:57 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-396f97ba-1eaf-4a82-974a-8f0b0ba37683 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:57 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-396f97ba-1eaf-4a82-974a-8f0b0ba37683 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-396f97ba-1eaf-4a82-974a-8f0b0ba37683 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-396f97ba-1eaf-4a82-974a-8f0b0ba37683 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:57 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:28:57 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:57 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-52f6b78d-8d45-4f72-8acc-25fb75ad832d tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6.info" returned: 0 in 0.786s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-52f6b78d-8d45-4f72-8acc-25fb75ad832d tempest-ProjectReaderTests-531722253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.272s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:57 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-52f6b78d-8d45-4f72-8acc-25fb75ad832d tempest-ProjectReaderTests-531722253 None] Create snapshot completed successfully Jul 08 01:28:58 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a5c16113-a7eb-4ea5-96fb-2b10395f3c36 tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165" returned: 0 in 1.085s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a5c16113-a7eb-4ea5-96fb-2b10395f3c36 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:58 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:58 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165 Jul 08 01:28:58 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-396f97ba-1eaf-4a82-974a-8f0b0ba37683 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.738s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:58 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-396f97ba-1eaf-4a82-974a-8f0b0ba37683 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:58 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-396f97ba-1eaf-4a82-974a-8f0b0ba37683 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Deleted volume successfully. Jul 08 01:28:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-396f97ba-1eaf-4a82-974a-8f0b0ba37683 tempest-CreateVolumesFromSourceVolumeTest-803446483 None] Lock "cinder-a8a32532-1071-48cd-90a3-a5ada3b18fa4-delete_volume" released by "delete_volume" :: held 3.006s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6b4a5f99-ee0d-42a7-9c44-ab8e6358a8b9 tempest-ProjectReaderTests-531722253 None] Acquiring lock "cinder-41d7bb95-3a77-4334-b403-435c3292a878-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6b4a5f99-ee0d-42a7-9c44-ab8e6358a8b9 tempest-ProjectReaderTests-531722253 None] Lock "cinder-41d7bb95-3a77-4334-b403-435c3292a878-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6b4a5f99-ee0d-42a7-9c44-ab8e6358a8b9 tempest-ProjectReaderTests-531722253 None] Acquiring lock "cinder-quobyte-48f1221c-a78e-4ffd-b5ec-228a3a37daa6" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6b4a5f99-ee0d-42a7-9c44-ab8e6358a8b9 tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-48f1221c-a78e-4ffd-b5ec-228a3a37daa6" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6b4a5f99-ee0d-42a7-9c44-ab8e6358a8b9 tempest-ProjectReaderTests-531722253 None] Acquiring lock "cinder-quobyte-41d7bb95-3a77-4334-b403-435c3292a878" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6b4a5f99-ee0d-42a7-9c44-ab8e6358a8b9 tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-41d7bb95-3a77-4334-b403-435c3292a878" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-6b4a5f99-ee0d-42a7-9c44-ab8e6358a8b9 tempest-ProjectReaderTests-531722253 None] Deleting offline snapshot 41d7bb95-3a77-4334-b403-435c3292a878 of volume 48f1221c-a78e-4ffd-b5ec-228a3a37daa6 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:28:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-6b4a5f99-ee0d-42a7-9c44-ab8e6358a8b9 tempest-ProjectReaderTests-531722253 None] snapshot_file for this snap is: volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6.41d7bb95-3a77-4334-b403-435c3292a878 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:28:58 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdc808a-b0c5-4b43-9f4a-0050268b6a6a]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b4a5f99-ee0d-42a7-9c44-ab8e6358a8b9 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6.41d7bb95-3a77-4334-b403-435c3292a878 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:58 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6.41d7bb95-3a77-4334-b403-435c3292a878 Jul 08 01:28:58 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:58 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a5c16113-a7eb-4ea5-96fb-2b10395f3c36 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e818188e-0f28-4ebe-8068-318fe2c59165" returned: 0 in 0.708s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a5c16113-a7eb-4ea5-96fb-2b10395f3c36 tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-e818188e-0f28-4ebe-8068-318fe2c59165" released by "delete_volume" :: held 1.863s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:58 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-a5c16113-a7eb-4ea5-96fb-2b10395f3c36 tempest-ProjectMemberTests-945597890 None] Created reservations ['2e422e36-ee9e-4fb7-b8f7-c544d8a65bea', '88d5f5e7-3114-4a36-8a18-77c1fded3277', '30dc7d0e-751f-42c5-a6de-2122614e6ab3', '555496d3-4d5e-48f4-8f99-360ab78f2410'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a5c16113-a7eb-4ea5-96fb-2b10395f3c36 tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a5c16113-a7eb-4ea5-96fb-2b10395f3c36 tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a5c16113-a7eb-4ea5-96fb-2b10395f3c36 tempest-ProjectMemberTests-945597890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a5c16113-a7eb-4ea5-96fb-2b10395f3c36 tempest-ProjectMemberTests-945597890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a5c16113-a7eb-4ea5-96fb-2b10395f3c36 tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a5c16113-a7eb-4ea5-96fb-2b10395f3c36 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:59 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:28:59 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Flow 'volume_create_manager' (7fcb056a-9260-404b-b3e0-ba2c755d2e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f78819-b851-40ad-9eb1-846b142f4b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:59 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b4a5f99-ee0d-42a7-9c44-ab8e6358a8b9 tempest-ProjectReaderTests-531722253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6.41d7bb95-3a77-4334-b403-435c3292a878" returned: 0 in 1.163s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-6b4a5f99-ee0d-42a7-9c44-ab8e6358a8b9 tempest-ProjectReaderTests-531722253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:28:59 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a5c16113-a7eb-4ea5-96fb-2b10395f3c36 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.869s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-a5c16113-a7eb-4ea5-96fb-2b10395f3c36 tempest-ProjectMemberTests-945597890 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7273e1f-58d2-4166-bccf-fb5a32e9e529]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b4a5f99-ee0d-42a7-9c44-ab8e6358a8b9 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f78819-b851-40ad-9eb1-846b142f4b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-875293402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b1a26cf-0db2-430a-ad16-f76d398d5f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043a2938932846aa9a07c898bce15405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:00Z,use_quota=True,user_id='a3976431e3344a96ad536addcf6110bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eb445c2-6241-430c-8e06-5f00a9235035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eb445c2-6241-430c-8e06-5f00a9235035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef4b274e-3458-42b5-ab41-70743d8959e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef4b274e-3458-42b5-ab41-70743d8959e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b1a26cf-0db2-430a-ad16-f76d398d5f74', 'volume_name': 'volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90611edd-0d1f-4c70-aaf4-6353a48beb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90611edd-0d1f-4c70-aaf4-6353a48beb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36707228-e883-4c29-88c7-3ce53720445c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:59 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Volume 8b1a26cf-0db2-430a-ad16-f76d398d5f74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74', 'volume_size': 1} Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-875293402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b1a26cf-0db2-430a-ad16-f76d398d5f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043a2938932846aa9a07c898bce15405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:00Z,use_quota=True,user_id='a3976431e3344a96ad536addcf6110bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Creating volume 8b1a26cf-0db2-430a-ad16-f76d398d5f74 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:00 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:00 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:29:00 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:29:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:00 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-a5c16113-a7eb-4ea5-96fb-2b10395f3c36 tempest-ProjectMemberTests-945597890 None] Deleted volume successfully. Jul 08 01:29:00 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74 1073741824 Jul 08 01:29:00 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:00 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a5c16113-a7eb-4ea5-96fb-2b10395f3c36 tempest-ProjectMemberTests-945597890 None] Lock "cinder-e818188e-0f28-4ebe-8068-318fe2c59165-delete_volume" released by "delete_volume" :: held 3.078s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:00 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6 Jul 08 01:29:00 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:00 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b4a5f99-ee0d-42a7-9c44-ab8e6358a8b9 tempest-ProjectReaderTests-531722253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6" returned: 0 in 0.871s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b4a5f99-ee0d-42a7-9c44-ab8e6358a8b9 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6.41d7bb95-3a77-4334-b403-435c3292a878 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:00 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6.41d7bb95-3a77-4334-b403-435c3292a878 Jul 08 01:29:00 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:01 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74 1073741824" returned: 0 in 1.087s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:01 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74 Jul 08 01:29:01 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:01 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b4a5f99-ee0d-42a7-9c44-ab8e6358a8b9 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6.41d7bb95-3a77-4334-b403-435c3292a878" returned: 0 in 0.827s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b4a5f99-ee0d-42a7-9c44-ab8e6358a8b9 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6.41d7bb95-3a77-4334-b403-435c3292a878 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:01 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6.41d7bb95-3a77-4334-b403-435c3292a878 Jul 08 01:29:01 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:01 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74" returned: 0 in 0.697s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:29:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36707228-e883-4c29-88c7-3ce53720445c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8414e990-f0ec-4798-8d98-72ac0261518e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:01 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Volume volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74 (8b1a26cf-0db2-430a-ad16-f76d398d5f74): created successfully Jul 08 01:29:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8414e990-f0ec-4798-8d98-72ac0261518e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Flow 'volume_create_manager' (7fcb056a-9260-404b-b3e0-ba2c755d2e9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:01 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-671a06db-e79e-4e25-91db-02193e33ee98 tempest-ProjectMemberTests-945597890 None] Created volume successfully. Jul 08 01:29:02 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-6b4a5f99-ee0d-42a7-9c44-ab8e6358a8b9 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6.41d7bb95-3a77-4334-b403-435c3292a878" returned: 0 in 0.751s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:02 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6b4a5f99-ee0d-42a7-9c44-ab8e6358a8b9 tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-41d7bb95-3a77-4334-b403-435c3292a878" released by "_delete_snapshot" :: held 3.737s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:02 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6b4a5f99-ee0d-42a7-9c44-ab8e6358a8b9 tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-48f1221c-a78e-4ffd-b5ec-228a3a37daa6" released by "delete_snapshot" :: held 3.763s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:02 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-6b4a5f99-ee0d-42a7-9c44-ab8e6358a8b9 tempest-ProjectReaderTests-531722253 None] Created reservations ['f41c2ce3-34a1-47ec-8450-b711ac49f035', 'ff23930d-8297-4000-b5ae-48e37269311e', '0ef5c2dc-4987-40ca-acc9-131f57e55ee7', 'ed5cb079-210c-4905-8704-842b3c9d148f'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:29:02 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-6b4a5f99-ee0d-42a7-9c44-ab8e6358a8b9 tempest-ProjectReaderTests-531722253 None] Delete snapshot completed successfully. Jul 08 01:29:02 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-6b4a5f99-ee0d-42a7-9c44-ab8e6358a8b9 tempest-ProjectReaderTests-531722253 None] Lock "cinder-41d7bb95-3a77-4334-b403-435c3292a878-delete_snapshot" released by "delete_snapshot" :: held 3.926s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5c8d9649-c56e-4178-bb56-a4dc34768fe8 tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5c8d9649-c56e-4178-bb56-a4dc34768fe8 tempest-ProjectMemberTests-945597890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:03 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4eacb2e5-e130-456a-988f-268169ea5d58 tempest-ProjectReaderTests-531722253 None] Acquiring lock "cinder-48f1221c-a78e-4ffd-b5ec-228a3a37daa6-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:03 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-5c8d9649-c56e-4178-bb56-a4dc34768fe8 tempest-ProjectMemberTests-945597890 None] Creating offline snapshot 9831e0f5-98d3-4e0b-a6e4-fb9112fc9fda of volume 8b1a26cf-0db2-430a-ad16-f76d398d5f74 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:29:03 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4eacb2e5-e130-456a-988f-268169ea5d58 tempest-ProjectReaderTests-531722253 None] Lock "cinder-48f1221c-a78e-4ffd-b5ec-228a3a37daa6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:03 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0e03d5-569a-4101-a634-3190d7fc2a8b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5c8d9649-c56e-4178-bb56-a4dc34768fe8 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:03 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4eacb2e5-e130-456a-988f-268169ea5d58 tempest-ProjectReaderTests-531722253 None] Acquiring lock "cinder-quobyte-48f1221c-a78e-4ffd-b5ec-228a3a37daa6" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:03 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4eacb2e5-e130-456a-988f-268169ea5d58 tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-48f1221c-a78e-4ffd-b5ec-228a3a37daa6" acquired by "delete_volume" :: waited 0.029s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:03 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe9bc92-a726-411a-8836-49390f74e07e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4eacb2e5-e130-456a-988f-268169ea5d58 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:03 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74 Jul 08 01:29:03 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:03 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6 Jul 08 01:29:03 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:03 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:29:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Flow 'volume_create_manager' (b298f336-df8d-4897-b391-7aaeac040941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abdafea9-10ea-43a8-ae7c-80f60286e0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abdafea9-10ea-43a8-ae7c-80f60286e0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1392f6fd-c397-4e4e-b08c-9e98063f4a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1c68e5b54b45ce94b9a740c24f248b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:04Z,use_quota=True,user_id='18c7df9f15204c41bca1800f962aa8a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b918b41f-0e77-4f89-8c61-fc5cf5b3abee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b918b41f-0e77-4f89-8c61-fc5cf5b3abee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96a7c23-950e-440f-80f4-1dde331bd1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:03 devstack cinder-volume[87022]: DEBUG cinder.image.glance [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Creating Keystone auth plugin from conf {{(pid=87022) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:29:04 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5c8d9649-c56e-4178-bb56-a4dc34768fe8 tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74" returned: 0 in 0.908s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5c8d9649-c56e-4178-bb56-a4dc34768fe8 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74.9831e0f5-98d3-4e0b-a6e4-fb9112fc9fda 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:04 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74.9831e0f5-98d3-4e0b-a6e4-fb9112fc9fda 1G Jul 08 01:29:04 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:04 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4eacb2e5-e130-456a-988f-268169ea5d58 tempest-ProjectReaderTests-531722253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6" returned: 0 in 0.956s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4eacb2e5-e130-456a-988f-268169ea5d58 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:04 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6 Jul 08 01:29:04 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:04 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96a7c23-950e-440f-80f4-1dde331bd1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1392f6fd-c397-4e4e-b08c-9e98063f4a75', 'volume_name': 'volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75', 'volume_size': 1, 'image_id': 'a774bff7-ee23-40fc-9389-2b86da0e244b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a774bff7-ee23-40fc-9389-2b86da0e244b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd7f6352bb8ce435eb846a42e57fd8fda', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0f1c68e5b54b45ce94b9a740c24f248b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd0ac7107cb1a8c59592ae0644473331d4991abd9f69564bc1584533d544e8ed365c8af6b0900004a9a39f1663b73ae87faa6487a0de33002fe1d6e36040361bb', 'id': 'a774bff7-ee23-40fc-9389-2b86da0e244b', 'created_at': datetime.datetime(2026, 7, 7, 23, 29, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 29, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a774bff7-ee23-40fc-9389-2b86da0e244b/file', 'properties': {}}, 'image_service': }' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:04 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35e18802-a6ae-4457-b024-4661223e2376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:04 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35e18802-a6ae-4457-b024-4661223e2376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:04 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (036de2c6-8595-4655-a0e4-6870cb91ad95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:04 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Volume 1392f6fd-c397-4e4e-b08c-9e98063f4a75: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75', 'volume_size': 1, 'image_id': 'a774bff7-ee23-40fc-9389-2b86da0e244b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a774bff7-ee23-40fc-9389-2b86da0e244b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd7f6352bb8ce435eb846a42e57fd8fda', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0f1c68e5b54b45ce94b9a740c24f248b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd0ac7107cb1a8c59592ae0644473331d4991abd9f69564bc1584533d544e8ed365c8af6b0900004a9a39f1663b73ae87faa6487a0de33002fe1d6e36040361bb', 'id': 'a774bff7-ee23-40fc-9389-2b86da0e244b', 'created_at': datetime.datetime(2026, 7, 7, 23, 29, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 29, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a774bff7-ee23-40fc-9389-2b86da0e244b/file', 'properties': {}}, 'image_service': } Jul 08 01:29:04 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Trying to clone 1392f6fd-c397-4e4e-b08c-9e98063f4a75 from image a774bff7-ee23-40fc-9389-2b86da0e244b at location (None, [{'url': 'file:///opt/stack/data/glance/images/a774bff7-ee23-40fc-9389-2b86da0e244b', 'metadata': {}}]). {{(pid=87022) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:29:04 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a774bff7-ee23-40fc-9389-2b86da0e244b_dqml326rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87022) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:29:04 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Image download 0.00 MB at 0.00 MB/s Jul 08 01:29:04 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bf6f65-bc94-4ce1-9599-a296bb191411]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a774bff7-ee23-40fc-9389-2b86da0e244b_dqml326rdevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:04 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a774bff7-ee23-40fc-9389-2b86da0e244b_dqml326rdevstack@QuobyteHD Jul 08 01:29:04 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:04 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5c8d9649-c56e-4178-bb56-a4dc34768fe8 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74.9831e0f5-98d3-4e0b-a6e4-fb9112fc9fda 1G" returned: 0 in 0.883s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5c8d9649-c56e-4178-bb56-a4dc34768fe8 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74.9831e0f5-98d3-4e0b-a6e4-fb9112fc9fda {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:04 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74.9831e0f5-98d3-4e0b-a6e4-fb9112fc9fda Jul 08 01:29:04 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:05 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4eacb2e5-e130-456a-988f-268169ea5d58 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-48f1221c-a78e-4ffd-b5ec-228a3a37daa6" returned: 0 in 0.778s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:05 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4eacb2e5-e130-456a-988f-268169ea5d58 tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-48f1221c-a78e-4ffd-b5ec-228a3a37daa6" released by "delete_volume" :: held 1.813s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:05 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-4eacb2e5-e130-456a-988f-268169ea5d58 tempest-ProjectReaderTests-531722253 None] Created reservations ['ac1c1741-97ed-4826-a0da-d690244ef2d7', 'e1af2116-93d2-4e55-abef-83abaa7a15f0', 'ad854736-7162-45d8-bba7-22f7762e00f4', 'e938ebbe-fe9a-4b2d-bdbf-72a64ebaa235'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:29:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4eacb2e5-e130-456a-988f-268169ea5d58 tempest-ProjectReaderTests-531722253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4eacb2e5-e130-456a-988f-268169ea5d58 tempest-ProjectReaderTests-531722253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:05 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4eacb2e5-e130-456a-988f-268169ea5d58 tempest-ProjectReaderTests-531722253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:05 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-4eacb2e5-e130-456a-988f-268169ea5d58 tempest-ProjectReaderTests-531722253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-4eacb2e5-e130-456a-988f-268169ea5d58 tempest-ProjectReaderTests-531722253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4eacb2e5-e130-456a-988f-268169ea5d58 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:05 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:29:05 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:05 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a774bff7-ee23-40fc-9389-2b86da0e244b_dqml326rdevstack@QuobyteHD" returned: 0 in 0.843s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a774bff7-ee23-40fc-9389-2b86da0e244b_dqml326rdevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:05 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a774bff7-ee23-40fc-9389-2b86da0e244b_dqml326rdevstack@QuobyteHD Jul 08 01:29:05 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:05 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5c8d9649-c56e-4178-bb56-a4dc34768fe8 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74.9831e0f5-98d3-4e0b-a6e4-fb9112fc9fda" returned: 0 in 0.806s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:05 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-5c8d9649-c56e-4178-bb56-a4dc34768fe8 tempest-ProjectMemberTests-945597890 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74.9831e0f5-98d3-4e0b-a6e4-fb9112fc9fda is being set with open permissions: ugo+rw Jul 08 01:29:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5c8d9649-c56e-4178-bb56-a4dc34768fe8 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74.9831e0f5-98d3-4e0b-a6e4-fb9112fc9fda {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:05 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74.9831e0f5-98d3-4e0b-a6e4-fb9112fc9fda Jul 08 01:29:05 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:05 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-4eacb2e5-e130-456a-988f-268169ea5d58 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.791s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:05 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-4eacb2e5-e130-456a-988f-268169ea5d58 tempest-ProjectReaderTests-531722253 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:29:05 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-4eacb2e5-e130-456a-988f-268169ea5d58 tempest-ProjectReaderTests-531722253 None] Deleted volume successfully. Jul 08 01:29:05 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=121,cinder:UPDATE=193,cinder:DELETE=14,cinder:INSERT=41 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:29:06 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:29:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Flow 'volume_create_manager' (28c9e7d5-0479-44a0-8db8-d1e85fd0141d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62da585f-3d15-4a2e-8410-ca99984ad8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:06 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-4eacb2e5-e130-456a-988f-268169ea5d58 tempest-ProjectReaderTests-531722253 None] Lock "cinder-48f1221c-a78e-4ffd-b5ec-228a3a37daa6-delete_volume" released by "delete_volume" :: held 2.893s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62da585f-3d15-4a2e-8410-ca99984ad8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-143824257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28abefcb-8e28-4a54-8c1a-5c665ef0d1ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef33caddaf744243b8124f7dd8c4d1e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:06Z,use_quota=True,user_id='b01a5b33fd3a461a963e8aa3700add02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb5c7dc1-b046-4258-ada2-be3f618a7579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb5c7dc1-b046-4258-ada2-be3f618a7579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1393e7b1-2d30-4f32-a351-da69d869e961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1393e7b1-2d30-4f32-a351-da69d869e961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28abefcb-8e28-4a54-8c1a-5c665ef0d1ed', 'volume_name': 'volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99ab5a4-f147-4d3d-a23b-96ca325941ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99ab5a4-f147-4d3d-a23b-96ca325941ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:06 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a48a940-99b8-43b3-a672-c5f4e16773e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:06 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Volume 28abefcb-8e28-4a54-8c1a-5c665ef0d1ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed', 'volume_size': 1} Jul 08 01:29:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:06 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a774bff7-ee23-40fc-9389-2b86da0e244b_dqml326rdevstack@QuobyteHD" returned: 1 in 0.892s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a774bff7-ee23-40fc-9389-2b86da0e244b_dqml326rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:29:06 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Temporary image a774bff7-ee23-40fc-9389-2b86da0e244b is fetched for user 18c7df9f15204c41bca1800f962aa8a9. {{(pid=87022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:29:06 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:DELETE=18,cinder:SELECT=135,cinder:UPDATE=167,cinder:INSERT=47 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:29:06 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[49aa45c2-d4c5-4747-bc20-12c3a1027fd6]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a774bff7-ee23-40fc-9389-2b86da0e244b_dqml326rdevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:06 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a774bff7-ee23-40fc-9389-2b86da0e244b_dqml326rdevstack@QuobyteHD Jul 08 01:29:06 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:06 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5c8d9649-c56e-4178-bb56-a4dc34768fe8 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74.9831e0f5-98d3-4e0b-a6e4-fb9112fc9fda" returned: 0 in 0.744s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5c8d9649-c56e-4178-bb56-a4dc34768fe8 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:06 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74.info Jul 08 01:29:06 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:07 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a774bff7-ee23-40fc-9389-2b86da0e244b_dqml326rdevstack@QuobyteHD" returned: 0 in 0.735s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a774bff7-ee23-40fc-9389-2b86da0e244b_dqml326rdevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:07 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a774bff7-ee23-40fc-9389-2b86da0e244b_dqml326rdevstack@QuobyteHD Jul 08 01:29:07 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:07 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5c8d9649-c56e-4178-bb56-a4dc34768fe8 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74.info" returned: 0 in 0.695s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:07 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-5c8d9649-c56e-4178-bb56-a4dc34768fe8 tempest-ProjectMemberTests-945597890 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74.info is being set with open permissions: ugo+rw Jul 08 01:29:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5c8d9649-c56e-4178-bb56-a4dc34768fe8 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:07 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74.info Jul 08 01:29:07 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:07 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a774bff7-ee23-40fc-9389-2b86da0e244b_dqml326rdevstack@QuobyteHD" returned: 1 in 0.741s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a774bff7-ee23-40fc-9389-2b86da0e244b_dqml326rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:29:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:07 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5c8d9649-c56e-4178-bb56-a4dc34768fe8 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74.info" returned: 0 in 0.700s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5c8d9649-c56e-4178-bb56-a4dc34768fe8 tempest-ProjectMemberTests-945597890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.853s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.854s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:07 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-143824257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28abefcb-8e28-4a54-8c1a-5c665ef0d1ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef33caddaf744243b8124f7dd8c4d1e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:06Z,use_quota=True,user_id='b01a5b33fd3a461a963e8aa3700add02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:29:07 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Creating volume 28abefcb-8e28-4a54-8c1a-5c665ef0d1ed {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:29:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:07 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:07 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:07 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:29:07 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:29:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:07 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed 1073741824 Jul 08 01:29:07 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:08 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-5c8d9649-c56e-4178-bb56-a4dc34768fe8 tempest-ProjectMemberTests-945597890 None] Create snapshot completed successfully Jul 08 01:29:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f7d89829-cb09-4fb7-8a30-493a40803ac3 tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-9831e0f5-98d3-4e0b-a6e4-fb9112fc9fda-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f7d89829-cb09-4fb7-8a30-493a40803ac3 tempest-ProjectMemberTests-945597890 None] Lock "cinder-9831e0f5-98d3-4e0b-a6e4-fb9112fc9fda-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f7d89829-cb09-4fb7-8a30-493a40803ac3 tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-quobyte-8b1a26cf-0db2-430a-ad16-f76d398d5f74" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f7d89829-cb09-4fb7-8a30-493a40803ac3 tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-8b1a26cf-0db2-430a-ad16-f76d398d5f74" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f7d89829-cb09-4fb7-8a30-493a40803ac3 tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-quobyte-9831e0f5-98d3-4e0b-a6e4-fb9112fc9fda" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f7d89829-cb09-4fb7-8a30-493a40803ac3 tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-9831e0f5-98d3-4e0b-a6e4-fb9112fc9fda" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:08 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-f7d89829-cb09-4fb7-8a30-493a40803ac3 tempest-ProjectMemberTests-945597890 None] Deleting offline snapshot 9831e0f5-98d3-4e0b-a6e4-fb9112fc9fda of volume 8b1a26cf-0db2-430a-ad16-f76d398d5f74 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:29:08 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-f7d89829-cb09-4fb7-8a30-493a40803ac3 tempest-ProjectMemberTests-945597890 None] snapshot_file for this snap is: volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74.9831e0f5-98d3-4e0b-a6e4-fb9112fc9fda {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:29:08 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4df7533-8e32-4cbd-935c-5fd13c4ed478]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f7d89829-cb09-4fb7-8a30-493a40803ac3 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74.9831e0f5-98d3-4e0b-a6e4-fb9112fc9fda {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:08 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74.9831e0f5-98d3-4e0b-a6e4-fb9112fc9fda Jul 08 01:29:08 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:08 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed 1073741824" returned: 0 in 0.866s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:08 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed Jul 08 01:29:08 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:09 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f7d89829-cb09-4fb7-8a30-493a40803ac3 tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74.9831e0f5-98d3-4e0b-a6e4-fb9112fc9fda" returned: 0 in 0.840s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-f7d89829-cb09-4fb7-8a30-493a40803ac3 tempest-ProjectMemberTests-945597890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:29:09 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b984726-3b7a-4401-a814-cf02cac1fc4b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f7d89829-cb09-4fb7-8a30-493a40803ac3 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:09 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74 Jul 08 01:29:09 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:09 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed" returned: 0 in 0.731s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:29:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.771s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1392f6fd-c397-4e4e-b08c-9e98063f4a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1c68e5b54b45ce94b9a740c24f248b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:04Z,use_quota=True,user_id='18c7df9f15204c41bca1800f962aa8a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:29:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Creating volume 1392f6fd-c397-4e4e-b08c-9e98063f4a75 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:29:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:29:09 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:29:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a48a940-99b8-43b3-a672-c5f4e16773e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bbd07b2-d0ca-4c62-ac1b-58065d398ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:09 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75 1073741824 Jul 08 01:29:09 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:09 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Volume volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed (28abefcb-8e28-4a54-8c1a-5c665ef0d1ed): created successfully Jul 08 01:29:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bbd07b2-d0ca-4c62-ac1b-58065d398ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Flow 'volume_create_manager' (28c9e7d5-0479-44a0-8db8-d1e85fd0141d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:09 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-d370381d-1660-434f-be30-35c511f96e7f tempest-ProjectReaderTests-531722253 None] Created volume successfully. Jul 08 01:29:10 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f7d89829-cb09-4fb7-8a30-493a40803ac3 tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74" returned: 0 in 0.873s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f7d89829-cb09-4fb7-8a30-493a40803ac3 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74.9831e0f5-98d3-4e0b-a6e4-fb9112fc9fda {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:10 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74.9831e0f5-98d3-4e0b-a6e4-fb9112fc9fda Jul 08 01:29:10 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bc41233b-c620-409a-9fd2-8802828bc98d tempest-ProjectReaderTests-531722253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:10 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75 1073741824" returned: 0 in 0.959s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:10 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75 Jul 08 01:29:10 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:11 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f7d89829-cb09-4fb7-8a30-493a40803ac3 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74.9831e0f5-98d3-4e0b-a6e4-fb9112fc9fda" returned: 0 in 0.855s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f7d89829-cb09-4fb7-8a30-493a40803ac3 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74.9831e0f5-98d3-4e0b-a6e4-fb9112fc9fda {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:11 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74.9831e0f5-98d3-4e0b-a6e4-fb9112fc9fda Jul 08 01:29:11 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:11 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75" returned: 0 in 0.636s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:11 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:29:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bc41233b-c620-409a-9fd2-8802828bc98d tempest-ProjectReaderTests-531722253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.840s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:11 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-bc41233b-c620-409a-9fd2-8802828bc98d tempest-ProjectReaderTests-531722253 None] Creating offline snapshot 4a2f1408-9d91-431f-839e-25551d8541a1 of volume 28abefcb-8e28-4a54-8c1a-5c665ef0d1ed {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:29:11 devstack cinder-volume[87022]: DEBUG cinder.volume.volume_utils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Attempting download of a774bff7-ee23-40fc-9389-2b86da0e244b ((None, [{'url': 'file:///opt/stack/data/glance/images/a774bff7-ee23-40fc-9389-2b86da0e244b', 'metadata': {}}])) to volume 1392f6fd-c397-4e4e-b08c-9e98063f4a75. {{(pid=87022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:29:11 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41e93b1-aa42-4fac-bfff-1f986e32863e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bc41233b-c620-409a-9fd2-8802828bc98d tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:11 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb1c5ff-d341-495a-b37f-1e7d8244cada]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a774bff7-ee23-40fc-9389-2b86da0e244b_2py70ua_ {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:11 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed Jul 08 01:29:11 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:11 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a774bff7-ee23-40fc-9389-2b86da0e244b_2py70ua_ Jul 08 01:29:11 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:11 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-f7d89829-cb09-4fb7-8a30-493a40803ac3 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74.9831e0f5-98d3-4e0b-a6e4-fb9112fc9fda" returned: 0 in 0.674s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:11 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f7d89829-cb09-4fb7-8a30-493a40803ac3 tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-9831e0f5-98d3-4e0b-a6e4-fb9112fc9fda" released by "_delete_snapshot" :: held 3.350s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:11 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f7d89829-cb09-4fb7-8a30-493a40803ac3 tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-8b1a26cf-0db2-430a-ad16-f76d398d5f74" released by "delete_snapshot" :: held 3.374s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:11 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-f7d89829-cb09-4fb7-8a30-493a40803ac3 tempest-ProjectMemberTests-945597890 None] Created reservations ['5d433e12-bc78-4621-a8ee-07fe8b622837', '0d075d0c-f6d0-4386-abda-7ac03a5166d2', 'ab2e6704-32f4-410b-8a6f-bae6dd0e15e7', '9531b8be-eb75-4ff0-a63f-6c058f8e4d35'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:29:11 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-f7d89829-cb09-4fb7-8a30-493a40803ac3 tempest-ProjectMemberTests-945597890 None] Delete snapshot completed successfully. Jul 08 01:29:11 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-f7d89829-cb09-4fb7-8a30-493a40803ac3 tempest-ProjectMemberTests-945597890 None] Lock "cinder-9831e0f5-98d3-4e0b-a6e4-fb9112fc9fda-delete_snapshot" released by "delete_snapshot" :: held 3.517s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:12 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bc41233b-c620-409a-9fd2-8802828bc98d tempest-ProjectReaderTests-531722253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed" returned: 0 in 0.794s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bc41233b-c620-409a-9fd2-8802828bc98d tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed.4a2f1408-9d91-431f-839e-25551d8541a1 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:12 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed.4a2f1408-9d91-431f-839e-25551d8541a1 1G Jul 08 01:29:12 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:12 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a774bff7-ee23-40fc-9389-2b86da0e244b_2py70ua_" returned: 0 in 0.808s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a774bff7-ee23-40fc-9389-2b86da0e244b_2py70ua_ {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:12 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a774bff7-ee23-40fc-9389-2b86da0e244b_2py70ua_ Jul 08 01:29:12 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:12 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0745db67-3e93-43e0-ab48-749aa10e6b08 tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-8b1a26cf-0db2-430a-ad16-f76d398d5f74-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:12 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0745db67-3e93-43e0-ab48-749aa10e6b08 tempest-ProjectMemberTests-945597890 None] Lock "cinder-8b1a26cf-0db2-430a-ad16-f76d398d5f74-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:12 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0745db67-3e93-43e0-ab48-749aa10e6b08 tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-quobyte-8b1a26cf-0db2-430a-ad16-f76d398d5f74" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:12 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0745db67-3e93-43e0-ab48-749aa10e6b08 tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-8b1a26cf-0db2-430a-ad16-f76d398d5f74" acquired by "delete_volume" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:12 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60ff940-ae4b-4919-9e59-01b3b0d8a625]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0745db67-3e93-43e0-ab48-749aa10e6b08 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:12 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74 Jul 08 01:29:12 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:12 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a774bff7-ee23-40fc-9389-2b86da0e244b_2py70ua_" returned: 1 in 0.791s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a774bff7-ee23-40fc-9389-2b86da0e244b_2py70ua_' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:29:12 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[36be8862-971f-418b-b7bb-48174717b0e1]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a774bff7-ee23-40fc-9389-2b86da0e244b_dqml326rdevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:13 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bc41233b-c620-409a-9fd2-8802828bc98d tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed.4a2f1408-9d91-431f-839e-25551d8541a1 1G" returned: 0 in 0.904s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bc41233b-c620-409a-9fd2-8802828bc98d tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed.4a2f1408-9d91-431f-839e-25551d8541a1 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:13 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed.4a2f1408-9d91-431f-839e-25551d8541a1 Jul 08 01:29:13 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:13 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a774bff7-ee23-40fc-9389-2b86da0e244b_dqml326rdevstack@QuobyteHD Jul 08 01:29:13 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:13 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0745db67-3e93-43e0-ab48-749aa10e6b08 tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74" returned: 0 in 0.822s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0745db67-3e93-43e0-ab48-749aa10e6b08 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:13 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74 Jul 08 01:29:13 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:13 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a774bff7-ee23-40fc-9389-2b86da0e244b_dqml326rdevstack@QuobyteHD" returned: 0 in 0.755s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a774bff7-ee23-40fc-9389-2b86da0e244b_dqml326rdevstack@QuobyteHD {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:13 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bc41233b-c620-409a-9fd2-8802828bc98d tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed.4a2f1408-9d91-431f-839e-25551d8541a1" returned: 0 in 0.734s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:13 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-bc41233b-c620-409a-9fd2-8802828bc98d tempest-ProjectReaderTests-531722253 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed.4a2f1408-9d91-431f-839e-25551d8541a1 is being set with open permissions: ugo+rw Jul 08 01:29:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bc41233b-c620-409a-9fd2-8802828bc98d tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed.4a2f1408-9d91-431f-839e-25551d8541a1 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:13 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed.4a2f1408-9d91-431f-839e-25551d8541a1 Jul 08 01:29:13 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:13 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a774bff7-ee23-40fc-9389-2b86da0e244b_dqml326rdevstack@QuobyteHD Jul 08 01:29:13 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:14 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0745db67-3e93-43e0-ab48-749aa10e6b08 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-8b1a26cf-0db2-430a-ad16-f76d398d5f74" returned: 0 in 0.700s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:14 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0745db67-3e93-43e0-ab48-749aa10e6b08 tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-8b1a26cf-0db2-430a-ad16-f76d398d5f74" released by "delete_volume" :: held 1.583s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:14 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-0745db67-3e93-43e0-ab48-749aa10e6b08 tempest-ProjectMemberTests-945597890 None] Created reservations ['2643761a-47ee-43f1-b536-9a1fe6317c01', 'f7cba4b2-72f8-4f8a-bbdd-e4f037ff0adb', 'c059633f-b44f-48f2-8526-f727ff2466bb', '84a5f23f-2a4a-47cd-b46c-bdaaa3f2f509'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:29:14 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:14 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bc41233b-c620-409a-9fd2-8802828bc98d tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed.4a2f1408-9d91-431f-839e-25551d8541a1" returned: 0 in 0.752s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a774bff7-ee23-40fc-9389-2b86da0e244b_dqml326rdevstack@QuobyteHD" returned: 1 in 0.796s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a774bff7-ee23-40fc-9389-2b86da0e244b_dqml326rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:29:14 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] a774bff7-ee23-40fc-9389-2b86da0e244b was raw, converting to raw {{(pid=87022) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:29:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a774bff7-ee23-40fc-9389-2b86da0e244b_dqml326rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:14 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a774bff7-ee23-40fc-9389-2b86da0e244b_dqml326rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75 Jul 08 01:29:14 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bc41233b-c620-409a-9fd2-8802828bc98d tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-0745db67-3e93-43e0-ab48-749aa10e6b08 tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-0745db67-3e93-43e0-ab48-749aa10e6b08 tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-0745db67-3e93-43e0-ab48-749aa10e6b08 tempest-ProjectMemberTests-945597890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:14 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed.info Jul 08 01:29:14 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:14 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-0745db67-3e93-43e0-ab48-749aa10e6b08 tempest-ProjectMemberTests-945597890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-0745db67-3e93-43e0-ab48-749aa10e6b08 tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0745db67-3e93-43e0-ab48-749aa10e6b08 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:14 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:29:14 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:15 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-0745db67-3e93-43e0-ab48-749aa10e6b08 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.773s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:15 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-0745db67-3e93-43e0-ab48-749aa10e6b08 tempest-ProjectMemberTests-945597890 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:29:15 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:15 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-0745db67-3e93-43e0-ab48-749aa10e6b08 tempest-ProjectMemberTests-945597890 None] Deleted volume successfully. Jul 08 01:29:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bc41233b-c620-409a-9fd2-8802828bc98d tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed.info" returned: 0 in 0.812s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:15 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-bc41233b-c620-409a-9fd2-8802828bc98d tempest-ProjectReaderTests-531722253 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed.info is being set with open permissions: ugo+rw Jul 08 01:29:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bc41233b-c620-409a-9fd2-8802828bc98d tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:15 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed.info Jul 08 01:29:15 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-0745db67-3e93-43e0-ab48-749aa10e6b08 tempest-ProjectMemberTests-945597890 None] Lock "cinder-8b1a26cf-0db2-430a-ad16-f76d398d5f74-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:15 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a774bff7-ee23-40fc-9389-2b86da0e244b_dqml326rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75" returned: 0 in 0.886s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:15 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a774bff7-ee23-40fc-9389-2b86da0e244b_dqml326rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75 {{(pid=87022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:29:15 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 01:29:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:15 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75 1G Jul 08 01:29:15 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:15 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:29:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Flow 'volume_create_manager' (d4c0850e-5727-4846-a838-4bbd5f1c65e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab677666-b62e-4c9f-ad8d-c677ab9a8375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab677666-b62e-4c9f-ad8d-c677ab9a8375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1080860079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da98783a-c89e-471c-aebb-dadf30f0b32b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043a2938932846aa9a07c898bce15405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:15Z,use_quota=True,user_id='a3976431e3344a96ad536addcf6110bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b62c6d9d-d47c-403a-b9f3-4c52bbe3a237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b62c6d9d-d47c-403a-b9f3-4c52bbe3a237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2238622-9112-4a82-a6b5-c49b1252c483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2238622-9112-4a82-a6b5-c49b1252c483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da98783a-c89e-471c-aebb-dadf30f0b32b', 'volume_name': 'volume-da98783a-c89e-471c-aebb-dadf30f0b32b', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fefb468d-aaf5-4f9b-9b24-744c9bee1d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fefb468d-aaf5-4f9b-9b24-744c9bee1d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6522f97c-8a5b-45e7-ab8a-962cc19fd33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:15 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Volume da98783a-c89e-471c-aebb-dadf30f0b32b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da98783a-c89e-471c-aebb-dadf30f0b32b', 'volume_size': 1} Jul 08 01:29:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:16 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bc41233b-c620-409a-9fd2-8802828bc98d tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed.info" returned: 0 in 0.664s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bc41233b-c620-409a-9fd2-8802828bc98d tempest-ProjectReaderTests-531722253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.802s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.417s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1080860079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da98783a-c89e-471c-aebb-dadf30f0b32b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043a2938932846aa9a07c898bce15405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:15Z,use_quota=True,user_id='a3976431e3344a96ad536addcf6110bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:29:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Creating volume da98783a-c89e-471c-aebb-dadf30f0b32b {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:29:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:29:16 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:29:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:16 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b 1073741824 Jul 08 01:29:16 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:16 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-bc41233b-c620-409a-9fd2-8802828bc98d tempest-ProjectReaderTests-531722253 None] Create snapshot completed successfully Jul 08 01:29:16 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75 1G" returned: 0 in 0.781s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:16 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0130db-0aa2-4993-add1-3b5ab15e16c1]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:16 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75 Jul 08 01:29:16 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-073be2d4-8711-4bfd-ad3b-e9be230fb2a4 tempest-ProjectReaderTests-531722253 None] Acquiring lock "cinder-4a2f1408-9d91-431f-839e-25551d8541a1-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-073be2d4-8711-4bfd-ad3b-e9be230fb2a4 tempest-ProjectReaderTests-531722253 None] Lock "cinder-4a2f1408-9d91-431f-839e-25551d8541a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-073be2d4-8711-4bfd-ad3b-e9be230fb2a4 tempest-ProjectReaderTests-531722253 None] Acquiring lock "cinder-quobyte-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-073be2d4-8711-4bfd-ad3b-e9be230fb2a4 tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-073be2d4-8711-4bfd-ad3b-e9be230fb2a4 tempest-ProjectReaderTests-531722253 None] Acquiring lock "cinder-quobyte-4a2f1408-9d91-431f-839e-25551d8541a1" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-073be2d4-8711-4bfd-ad3b-e9be230fb2a4 tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-4a2f1408-9d91-431f-839e-25551d8541a1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-073be2d4-8711-4bfd-ad3b-e9be230fb2a4 tempest-ProjectReaderTests-531722253 None] Deleting offline snapshot 4a2f1408-9d91-431f-839e-25551d8541a1 of volume 28abefcb-8e28-4a54-8c1a-5c665ef0d1ed {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:29:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-073be2d4-8711-4bfd-ad3b-e9be230fb2a4 tempest-ProjectReaderTests-531722253 None] snapshot_file for this snap is: volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed.4a2f1408-9d91-431f-839e-25551d8541a1 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:29:16 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4298e2-68b7-49b1-9f40-e380af4058c2]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-073be2d4-8711-4bfd-ad3b-e9be230fb2a4 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed.4a2f1408-9d91-431f-839e-25551d8541a1 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:17 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed.4a2f1408-9d91-431f-839e-25551d8541a1 Jul 08 01:29:17 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:17 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b 1073741824" returned: 0 in 1.084s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:17 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b Jul 08 01:29:17 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:17 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75" returned: 0 in 1.021s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:17 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75 Jul 08 01:29:17 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:17 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-073be2d4-8711-4bfd-ad3b-e9be230fb2a4 tempest-ProjectReaderTests-531722253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed.4a2f1408-9d91-431f-839e-25551d8541a1" returned: 0 in 0.937s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-073be2d4-8711-4bfd-ad3b-e9be230fb2a4 tempest-ProjectReaderTests-531722253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:29:17 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b" returned: 0 in 0.727s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] <== create_volume: return (1863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:29:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:17 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e0f67a-7f4c-49fc-a944-e7b176c776df]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-073be2d4-8711-4bfd-ad3b-e9be230fb2a4 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6522f97c-8a5b-45e7-ab8a-962cc19fd33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da98783a-c89e-471c-aebb-dadf30f0b32b', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2bc2379-456a-4676-854e-3b32f82c54cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:17 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Volume volume-da98783a-c89e-471c-aebb-dadf30f0b32b (da98783a-c89e-471c-aebb-dadf30f0b32b): created successfully Jul 08 01:29:17 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2bc2379-456a-4676-854e-3b32f82c54cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Flow 'volume_create_manager' (d4c0850e-5727-4846-a838-4bbd5f1c65e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:18 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-228e6c36-e8a5-4c10-9c65-ca6beef1ea77 tempest-ProjectMemberTests-945597890 None] Created volume successfully. Jul 08 01:29:18 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed Jul 08 01:29:18 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:18 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75" returned: 1 in 0.859s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:29:18 devstack cinder-volume[87022]: DEBUG cinder.volume.volume_utils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Downloaded image a774bff7-ee23-40fc-9389-2b86da0e244b ((None, [{'url': 'file:///opt/stack/data/glance/images/a774bff7-ee23-40fc-9389-2b86da0e244b', 'metadata': {}}])) to volume 1392f6fd-c397-4e4e-b08c-9e98063f4a75 successfully. {{(pid=87022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:29:18 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Temporary image a774bff7-ee23-40fc-9389-2b86da0e244b for user 18c7df9f15204c41bca1800f962aa8a9 is deleted. {{(pid=87022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:29:18 devstack cinder-volume[87022]: DEBUG cinder.volume.volume_utils [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Marking volume 1392f6fd-c397-4e4e-b08c-9e98063f4a75 as bootable. {{(pid=87022) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:29:18 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Copying metadata from image a774bff7-ee23-40fc-9389-2b86da0e244b to 1392f6fd-c397-4e4e-b08c-9e98063f4a75. {{(pid=87022) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:29:18 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Creating volume glance metadata for volume 1392f6fd-c397-4e4e-b08c-9e98063f4a75 backed by image a774bff7-ee23-40fc-9389-2b86da0e244b with: {'image_id': 'a774bff7-ee23-40fc-9389-2b86da0e244b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd7f6352bb8ce435eb846a42e57fd8fda', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87022) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:29:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (036de2c6-8595-4655-a0e4-6870cb91ad95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75', 'volume_size': 1, 'image_id': 'a774bff7-ee23-40fc-9389-2b86da0e244b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a774bff7-ee23-40fc-9389-2b86da0e244b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd7f6352bb8ce435eb846a42e57fd8fda', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0f1c68e5b54b45ce94b9a740c24f248b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd0ac7107cb1a8c59592ae0644473331d4991abd9f69564bc1584533d544e8ed365c8af6b0900004a9a39f1663b73ae87faa6487a0de33002fe1d6e36040361bb', 'id': 'a774bff7-ee23-40fc-9389-2b86da0e244b', 'created_at': datetime.datetime(2026, 7, 7, 23, 29, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 29, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a774bff7-ee23-40fc-9389-2b86da0e244b/file', 'properties': {}}, 'image_service': }' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9ffc1b-5504-41dc-a560-b8e7fae2ac2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:18 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Volume volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75 (1392f6fd-c397-4e4e-b08c-9e98063f4a75): created successfully Jul 08 01:29:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9ffc1b-5504-41dc-a560-b8e7fae2ac2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Flow 'volume_create_manager' (b298f336-df8d-4897-b391-7aaeac040941) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:18 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-490e9fdd-1ca6-4671-8193-a4918714a46a tempest-VolumeImageDependencyTests-405908139 None] Created volume successfully. Jul 08 01:29:18 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-073be2d4-8711-4bfd-ad3b-e9be230fb2a4 tempest-ProjectReaderTests-531722253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed" returned: 0 in 0.837s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-073be2d4-8711-4bfd-ad3b-e9be230fb2a4 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed.4a2f1408-9d91-431f-839e-25551d8541a1 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:18 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed.4a2f1408-9d91-431f-839e-25551d8541a1 Jul 08 01:29:18 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a1e11997-7545-4542-a125-20c255c7e618 tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a1e11997-7545-4542-a125-20c255c7e618 tempest-ProjectMemberTests-945597890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:18 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-a1e11997-7545-4542-a125-20c255c7e618 tempest-ProjectMemberTests-945597890 None] Creating offline snapshot 447c6536-dbd2-489e-b3c3-7c71bfa108a0 of volume da98783a-c89e-471c-aebb-dadf30f0b32b {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:29:18 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6efbd5-5bb1-47ef-9b17-8efeda1e28f0]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a1e11997-7545-4542-a125-20c255c7e618 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2723d7b6-54c4-4c29-8c12-40337a62d8c1 tempest-VolumeImageDependencyTests-405908139 None] Acquiring lock "cinder-1392f6fd-c397-4e4e-b08c-9e98063f4a75-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2723d7b6-54c4-4c29-8c12-40337a62d8c1 tempest-VolumeImageDependencyTests-405908139 None] Lock "cinder-1392f6fd-c397-4e4e-b08c-9e98063f4a75-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:19 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b Jul 08 01:29:19 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2723d7b6-54c4-4c29-8c12-40337a62d8c1 tempest-VolumeImageDependencyTests-405908139 None] Acquiring lock "cinder-quobyte-1392f6fd-c397-4e4e-b08c-9e98063f4a75" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2723d7b6-54c4-4c29-8c12-40337a62d8c1 tempest-VolumeImageDependencyTests-405908139 None] Lock "cinder-quobyte-1392f6fd-c397-4e4e-b08c-9e98063f4a75" acquired by "delete_volume" :: waited 0.019s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:19 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4c9054-f030-445d-8336-81489eab1f95]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2723d7b6-54c4-4c29-8c12-40337a62d8c1 tempest-VolumeImageDependencyTests-405908139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:19 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75 Jul 08 01:29:19 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:19 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-073be2d4-8711-4bfd-ad3b-e9be230fb2a4 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed.4a2f1408-9d91-431f-839e-25551d8541a1" returned: 0 in 0.819s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-073be2d4-8711-4bfd-ad3b-e9be230fb2a4 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed.4a2f1408-9d91-431f-839e-25551d8541a1 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:19 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed.4a2f1408-9d91-431f-839e-25551d8541a1 Jul 08 01:29:19 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:19 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a1e11997-7545-4542-a125-20c255c7e618 tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b" returned: 0 in 0.891s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a1e11997-7545-4542-a125-20c255c7e618 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b.447c6536-dbd2-489e-b3c3-7c71bfa108a0 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:19 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b.447c6536-dbd2-489e-b3c3-7c71bfa108a0 1G Jul 08 01:29:19 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:20 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2723d7b6-54c4-4c29-8c12-40337a62d8c1 tempest-VolumeImageDependencyTests-405908139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75" returned: 0 in 0.800s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2723d7b6-54c4-4c29-8c12-40337a62d8c1 tempest-VolumeImageDependencyTests-405908139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:20 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75 Jul 08 01:29:20 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:20 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-073be2d4-8711-4bfd-ad3b-e9be230fb2a4 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed.4a2f1408-9d91-431f-839e-25551d8541a1" returned: 0 in 0.710s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-073be2d4-8711-4bfd-ad3b-e9be230fb2a4 tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-4a2f1408-9d91-431f-839e-25551d8541a1" released by "_delete_snapshot" :: held 3.450s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-073be2d4-8711-4bfd-ad3b-e9be230fb2a4 tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed" released by "delete_snapshot" :: held 3.474s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:20 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-073be2d4-8711-4bfd-ad3b-e9be230fb2a4 tempest-ProjectReaderTests-531722253 None] Created reservations ['803d0ebd-a745-4486-ae4f-79785affaf9e', '5fcd8cd6-1cea-4389-a62e-0ec34b443811', 'c05fb784-1adc-4577-a333-a48e0fe7e3ae', 'fe0f7f03-745b-4856-be96-524c8cbc1047'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:29:20 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-073be2d4-8711-4bfd-ad3b-e9be230fb2a4 tempest-ProjectReaderTests-531722253 None] Delete snapshot completed successfully. Jul 08 01:29:20 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-073be2d4-8711-4bfd-ad3b-e9be230fb2a4 tempest-ProjectReaderTests-531722253 None] Lock "cinder-4a2f1408-9d91-431f-839e-25551d8541a1-delete_snapshot" released by "delete_snapshot" :: held 3.642s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:20 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a1e11997-7545-4542-a125-20c255c7e618 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b.447c6536-dbd2-489e-b3c3-7c71bfa108a0 1G" returned: 0 in 0.832s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a1e11997-7545-4542-a125-20c255c7e618 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da98783a-c89e-471c-aebb-dadf30f0b32b -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b.447c6536-dbd2-489e-b3c3-7c71bfa108a0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:20 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da98783a-c89e-471c-aebb-dadf30f0b32b -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b.447c6536-dbd2-489e-b3c3-7c71bfa108a0 Jul 08 01:29:20 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:20 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2723d7b6-54c4-4c29-8c12-40337a62d8c1 tempest-VolumeImageDependencyTests-405908139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75" returned: 1 in 0.802s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2723d7b6-54c4-4c29-8c12-40337a62d8c1 tempest-VolumeImageDependencyTests-405908139 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75' failed. Not Retrying. {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:29:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2723d7b6-54c4-4c29-8c12-40337a62d8c1 tempest-VolumeImageDependencyTests-405908139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:20 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75 Jul 08 01:29:20 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:21 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7190b24a-2f53-4e8c-8ac8-2b3d75a63a88 tempest-ProjectReaderTests-531722253 None] Acquiring lock "cinder-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:21 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7190b24a-2f53-4e8c-8ac8-2b3d75a63a88 tempest-ProjectReaderTests-531722253 None] Lock "cinder-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:21 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7190b24a-2f53-4e8c-8ac8-2b3d75a63a88 tempest-ProjectReaderTests-531722253 None] Acquiring lock "cinder-quobyte-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:21 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7190b24a-2f53-4e8c-8ac8-2b3d75a63a88 tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed" acquired by "delete_volume" :: waited 0.015s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:21 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[548c7b92-81cc-4087-ab7c-1bec8602c8df]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7190b24a-2f53-4e8c-8ac8-2b3d75a63a88 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:21 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed Jul 08 01:29:21 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:21 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a1e11997-7545-4542-a125-20c255c7e618 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da98783a-c89e-471c-aebb-dadf30f0b32b -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b.447c6536-dbd2-489e-b3c3-7c71bfa108a0" returned: 0 in 0.743s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:21 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-a1e11997-7545-4542-a125-20c255c7e618 tempest-ProjectMemberTests-945597890 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b.447c6536-dbd2-489e-b3c3-7c71bfa108a0 is being set with open permissions: ugo+rw Jul 08 01:29:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a1e11997-7545-4542-a125-20c255c7e618 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b.447c6536-dbd2-489e-b3c3-7c71bfa108a0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:21 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b.447c6536-dbd2-489e-b3c3-7c71bfa108a0 Jul 08 01:29:21 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:21 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2723d7b6-54c4-4c29-8c12-40337a62d8c1 tempest-VolumeImageDependencyTests-405908139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1392f6fd-c397-4e4e-b08c-9e98063f4a75" returned: 0 in 0.674s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:21 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2723d7b6-54c4-4c29-8c12-40337a62d8c1 tempest-VolumeImageDependencyTests-405908139 None] Lock "cinder-quobyte-1392f6fd-c397-4e4e-b08c-9e98063f4a75" released by "delete_volume" :: held 2.353s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:21 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-2723d7b6-54c4-4c29-8c12-40337a62d8c1 tempest-VolumeImageDependencyTests-405908139 None] Created reservations ['5020ca5b-5245-490d-bc31-73b1d10afb88', 'aa033b41-732d-4b37-8b9c-90ccfd0d489f', 'f74ed67a-df4e-4289-9b5c-29f838325878', '3ab1463c-25f2-4252-9b4c-24ff8eeb5d73'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:29:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2723d7b6-54c4-4c29-8c12-40337a62d8c1 tempest-VolumeImageDependencyTests-405908139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2723d7b6-54c4-4c29-8c12-40337a62d8c1 tempest-VolumeImageDependencyTests-405908139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-2723d7b6-54c4-4c29-8c12-40337a62d8c1 tempest-VolumeImageDependencyTests-405908139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:21 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-2723d7b6-54c4-4c29-8c12-40337a62d8c1 tempest-VolumeImageDependencyTests-405908139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2723d7b6-54c4-4c29-8c12-40337a62d8c1 tempest-VolumeImageDependencyTests-405908139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2723d7b6-54c4-4c29-8c12-40337a62d8c1 tempest-VolumeImageDependencyTests-405908139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:21 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:29:21 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:22 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a1e11997-7545-4542-a125-20c255c7e618 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b.447c6536-dbd2-489e-b3c3-7c71bfa108a0" returned: 0 in 0.667s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:22 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7190b24a-2f53-4e8c-8ac8-2b3d75a63a88 tempest-ProjectReaderTests-531722253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed" returned: 0 in 0.841s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7190b24a-2f53-4e8c-8ac8-2b3d75a63a88 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a1e11997-7545-4542-a125-20c255c7e618 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:22 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed Jul 08 01:29:22 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:22 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b.info Jul 08 01:29:22 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:22 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2723d7b6-54c4-4c29-8c12-40337a62d8c1 tempest-VolumeImageDependencyTests-405908139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.750s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:22 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-2723d7b6-54c4-4c29-8c12-40337a62d8c1 tempest-VolumeImageDependencyTests-405908139 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:29:22 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-2723d7b6-54c4-4c29-8c12-40337a62d8c1 tempest-VolumeImageDependencyTests-405908139 None] Deleted volume successfully. Jul 08 01:29:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2723d7b6-54c4-4c29-8c12-40337a62d8c1 tempest-VolumeImageDependencyTests-405908139 None] Lock "cinder-1392f6fd-c397-4e4e-b08c-9e98063f4a75-delete_volume" released by "delete_volume" :: held 3.344s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:22 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7190b24a-2f53-4e8c-8ac8-2b3d75a63a88 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed" returned: 0 in 0.698s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7190b24a-2f53-4e8c-8ac8-2b3d75a63a88 tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed" released by "delete_volume" :: held 1.610s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:22 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a1e11997-7545-4542-a125-20c255c7e618 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b.info" returned: 0 in 0.729s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:22 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-a1e11997-7545-4542-a125-20c255c7e618 tempest-ProjectMemberTests-945597890 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b.info is being set with open permissions: ugo+rw Jul 08 01:29:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a1e11997-7545-4542-a125-20c255c7e618 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:22 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b.info Jul 08 01:29:22 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:22 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-7190b24a-2f53-4e8c-8ac8-2b3d75a63a88 tempest-ProjectReaderTests-531722253 None] Created reservations ['a3f91aa4-e40f-4e79-beb4-975a541deb3f', 'e1622a6d-1ec3-45b2-9d39-ce95cc7ad6ea', '7bcd84bd-7a43-4e4e-b61c-1be1964ef7c6', '9915b30d-59bf-4cdb-88f3-0379001e2d94'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:29:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7190b24a-2f53-4e8c-8ac8-2b3d75a63a88 tempest-ProjectReaderTests-531722253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7190b24a-2f53-4e8c-8ac8-2b3d75a63a88 tempest-ProjectReaderTests-531722253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:22 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7190b24a-2f53-4e8c-8ac8-2b3d75a63a88 tempest-ProjectReaderTests-531722253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7190b24a-2f53-4e8c-8ac8-2b3d75a63a88 tempest-ProjectReaderTests-531722253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7190b24a-2f53-4e8c-8ac8-2b3d75a63a88 tempest-ProjectReaderTests-531722253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7190b24a-2f53-4e8c-8ac8-2b3d75a63a88 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:23 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:29:23 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:23 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a1e11997-7545-4542-a125-20c255c7e618 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b.info" returned: 0 in 0.755s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a1e11997-7545-4542-a125-20c255c7e618 tempest-ProjectMemberTests-945597890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.750s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:23 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-a1e11997-7545-4542-a125-20c255c7e618 tempest-ProjectMemberTests-945597890 None] Create snapshot completed successfully Jul 08 01:29:23 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7190b24a-2f53-4e8c-8ac8-2b3d75a63a88 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.855s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:23 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-7190b24a-2f53-4e8c-8ac8-2b3d75a63a88 tempest-ProjectReaderTests-531722253 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:29:23 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-7190b24a-2f53-4e8c-8ac8-2b3d75a63a88 tempest-ProjectReaderTests-531722253 None] Deleted volume successfully. Jul 08 01:29:23 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-7190b24a-2f53-4e8c-8ac8-2b3d75a63a88 tempest-ProjectReaderTests-531722253 None] Lock "cinder-28abefcb-8e28-4a54-8c1a-5c665ef0d1ed-delete_volume" released by "delete_volume" :: held 2.738s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:23 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:29:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Flow 'volume_create_manager' (fff8cec4-3373-42b0-99c7-31196d76b57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:23 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb872e7-c533-4841-86ee-4fe112195e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb872e7-c533-4841-86ee-4fe112195e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-794561039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1337d02d-b46f-4236-998b-ce21d579c252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef33caddaf744243b8124f7dd8c4d1e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:24Z,use_quota=True,user_id='b01a5b33fd3a461a963e8aa3700add02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0059362-a2c5-4de6-a4a2-42ef03162180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0059362-a2c5-4de6-a4a2-42ef03162180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d81cc104-28b2-499f-ba92-85ce05b9e061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d81cc104-28b2-499f-ba92-85ce05b9e061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1337d02d-b46f-4236-998b-ce21d579c252', 'volume_name': 'volume-1337d02d-b46f-4236-998b-ce21d579c252', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57bc91cc-166c-49a6-99b4-f993a10cdd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57bc91cc-166c-49a6-99b4-f993a10cdd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a5a153-342c-4dd2-b74c-4c334601b9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:24 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Volume 1337d02d-b46f-4236-998b-ce21d579c252: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1337d02d-b46f-4236-998b-ce21d579c252', 'volume_size': 1} Jul 08 01:29:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-794561039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1337d02d-b46f-4236-998b-ce21d579c252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef33caddaf744243b8124f7dd8c4d1e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:24Z,use_quota=True,user_id='b01a5b33fd3a461a963e8aa3700add02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:29:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Creating volume 1337d02d-b46f-4236-998b-ce21d579c252 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:29:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:29:24 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:29:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:24 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252 1073741824 Jul 08 01:29:24 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ba443876-29cb-4789-8a73-dc80452fb057 tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-447c6536-dbd2-489e-b3c3-7c71bfa108a0-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ba443876-29cb-4789-8a73-dc80452fb057 tempest-ProjectMemberTests-945597890 None] Lock "cinder-447c6536-dbd2-489e-b3c3-7c71bfa108a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ba443876-29cb-4789-8a73-dc80452fb057 tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-quobyte-da98783a-c89e-471c-aebb-dadf30f0b32b" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ba443876-29cb-4789-8a73-dc80452fb057 tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-da98783a-c89e-471c-aebb-dadf30f0b32b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ba443876-29cb-4789-8a73-dc80452fb057 tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-quobyte-447c6536-dbd2-489e-b3c3-7c71bfa108a0" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ba443876-29cb-4789-8a73-dc80452fb057 tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-447c6536-dbd2-489e-b3c3-7c71bfa108a0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-ba443876-29cb-4789-8a73-dc80452fb057 tempest-ProjectMemberTests-945597890 None] Deleting offline snapshot 447c6536-dbd2-489e-b3c3-7c71bfa108a0 of volume da98783a-c89e-471c-aebb-dadf30f0b32b {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:29:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-ba443876-29cb-4789-8a73-dc80452fb057 tempest-ProjectMemberTests-945597890 None] snapshot_file for this snap is: volume-da98783a-c89e-471c-aebb-dadf30f0b32b.447c6536-dbd2-489e-b3c3-7c71bfa108a0 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:29:24 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e02830-861d-4c36-9a5a-dacaa403b3ef]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ba443876-29cb-4789-8a73-dc80452fb057 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b.447c6536-dbd2-489e-b3c3-7c71bfa108a0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:24 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b.447c6536-dbd2-489e-b3c3-7c71bfa108a0 Jul 08 01:29:24 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:25 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252 1073741824" returned: 0 in 0.991s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:25 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252 Jul 08 01:29:25 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:25 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ba443876-29cb-4789-8a73-dc80452fb057 tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b.447c6536-dbd2-489e-b3c3-7c71bfa108a0" returned: 0 in 0.898s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-ba443876-29cb-4789-8a73-dc80452fb057 tempest-ProjectMemberTests-945597890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da98783a-c89e-471c-aebb-dadf30f0b32b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:29:25 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbed2d9e-75f2-4ec1-8a7b-3c343cc1f007]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ba443876-29cb-4789-8a73-dc80452fb057 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:25 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b Jul 08 01:29:25 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:25 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252" returned: 0 in 0.722s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:25 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:29:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a5a153-342c-4dd2-b74c-4c334601b9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1337d02d-b46f-4236-998b-ce21d579c252', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe5e4e0b-23ca-4a5c-8804-30f000b074a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:25 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Volume volume-1337d02d-b46f-4236-998b-ce21d579c252 (1337d02d-b46f-4236-998b-ce21d579c252): created successfully Jul 08 01:29:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe5e4e0b-23ca-4a5c-8804-30f000b074a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:25 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Flow 'volume_create_manager' (fff8cec4-3373-42b0-99c7-31196d76b57b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:25 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-53b19edd-c794-4239-862b-c5833ab28497 tempest-ProjectReaderTests-531722253 None] Created volume successfully. Jul 08 01:29:26 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ba443876-29cb-4789-8a73-dc80452fb057 tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b" returned: 0 in 0.853s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ba443876-29cb-4789-8a73-dc80452fb057 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b.447c6536-dbd2-489e-b3c3-7c71bfa108a0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:26 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b.447c6536-dbd2-489e-b3c3-7c71bfa108a0 Jul 08 01:29:26 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-fdbece72-52e8-4393-8bde-737697963661 tempest-ProjectReaderTests-531722253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-fdbece72-52e8-4393-8bde-737697963661 tempest-ProjectReaderTests-531722253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:26 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-fdbece72-52e8-4393-8bde-737697963661 tempest-ProjectReaderTests-531722253 None] Creating offline snapshot 0f43a418-9965-4535-bb89-9baa92f5d75c of volume 1337d02d-b46f-4236-998b-ce21d579c252 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:29:26 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7311f36-606a-44b4-b766-ea1ec449cd11]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fdbece72-52e8-4393-8bde-737697963661 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:26 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252 Jul 08 01:29:26 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:26 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-ba87edb1-3754-47b7-b24c-bdb101d0bf29 tempest-ProjectAdminTests-375547425 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.597396850586, 'free_capacity_gb': 1775.597396850586, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87022) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 01:29:26 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ba443876-29cb-4789-8a73-dc80452fb057 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b.447c6536-dbd2-489e-b3c3-7c71bfa108a0" returned: 0 in 0.749s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ba443876-29cb-4789-8a73-dc80452fb057 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b.447c6536-dbd2-489e-b3c3-7c71bfa108a0 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:26 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b.447c6536-dbd2-489e-b3c3-7c71bfa108a0 Jul 08 01:29:26 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:27 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fdbece72-52e8-4393-8bde-737697963661 tempest-ProjectReaderTests-531722253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252" returned: 0 in 0.783s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fdbece72-52e8-4393-8bde-737697963661 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252.0f43a418-9965-4535-bb89-9baa92f5d75c 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:27 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252.0f43a418-9965-4535-bb89-9baa92f5d75c 1G Jul 08 01:29:27 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:27 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ba443876-29cb-4789-8a73-dc80452fb057 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b.447c6536-dbd2-489e-b3c3-7c71bfa108a0" returned: 0 in 0.688s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ba443876-29cb-4789-8a73-dc80452fb057 tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-447c6536-dbd2-489e-b3c3-7c71bfa108a0" released by "_delete_snapshot" :: held 3.321s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ba443876-29cb-4789-8a73-dc80452fb057 tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-da98783a-c89e-471c-aebb-dadf30f0b32b" released by "delete_snapshot" :: held 3.352s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:27 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-ba443876-29cb-4789-8a73-dc80452fb057 tempest-ProjectMemberTests-945597890 None] Created reservations ['91188915-7864-4ccc-a5cb-c5f32c0e917b', '4ddbe67d-e3ed-4d9a-bb8b-929514ef37e4', 'ec6f23d6-0ad1-4e1d-ae10-e4df78831d17', '5928407e-f7a0-4a0f-b4c2-c0d6ec6131a0'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:29:27 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-ba443876-29cb-4789-8a73-dc80452fb057 tempest-ProjectMemberTests-945597890 None] Delete snapshot completed successfully. Jul 08 01:29:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ba443876-29cb-4789-8a73-dc80452fb057 tempest-ProjectMemberTests-945597890 None] Lock "cinder-447c6536-dbd2-489e-b3c3-7c71bfa108a0-delete_snapshot" released by "delete_snapshot" :: held 3.531s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:27 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fdbece72-52e8-4393-8bde-737697963661 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252.0f43a418-9965-4535-bb89-9baa92f5d75c 1G" returned: 0 in 0.882s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fdbece72-52e8-4393-8bde-737697963661 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1337d02d-b46f-4236-998b-ce21d579c252 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252.0f43a418-9965-4535-bb89-9baa92f5d75c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:28 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1337d02d-b46f-4236-998b-ce21d579c252 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252.0f43a418-9965-4535-bb89-9baa92f5d75c Jul 08 01:29:28 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ba9daabf-92d8-41e3-ba24-4dc89ea0a84a tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-da98783a-c89e-471c-aebb-dadf30f0b32b-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ba9daabf-92d8-41e3-ba24-4dc89ea0a84a tempest-ProjectMemberTests-945597890 None] Lock "cinder-da98783a-c89e-471c-aebb-dadf30f0b32b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ba9daabf-92d8-41e3-ba24-4dc89ea0a84a tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-quobyte-da98783a-c89e-471c-aebb-dadf30f0b32b" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:28 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ba9daabf-92d8-41e3-ba24-4dc89ea0a84a tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-da98783a-c89e-471c-aebb-dadf30f0b32b" acquired by "delete_volume" :: waited 0.020s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:28 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[46768ebc-9de8-4bbb-ae01-0cf7411a2400]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ba9daabf-92d8-41e3-ba24-4dc89ea0a84a tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:28 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b Jul 08 01:29:28 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:28 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fdbece72-52e8-4393-8bde-737697963661 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1337d02d-b46f-4236-998b-ce21d579c252 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252.0f43a418-9965-4535-bb89-9baa92f5d75c" returned: 0 in 0.860s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:28 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-fdbece72-52e8-4393-8bde-737697963661 tempest-ProjectReaderTests-531722253 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252.0f43a418-9965-4535-bb89-9baa92f5d75c is being set with open permissions: ugo+rw Jul 08 01:29:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fdbece72-52e8-4393-8bde-737697963661 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252.0f43a418-9965-4535-bb89-9baa92f5d75c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:28 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252.0f43a418-9965-4535-bb89-9baa92f5d75c Jul 08 01:29:28 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:29 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ba9daabf-92d8-41e3-ba24-4dc89ea0a84a tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b" returned: 0 in 0.866s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ba9daabf-92d8-41e3-ba24-4dc89ea0a84a tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:29 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b Jul 08 01:29:29 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:29 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fdbece72-52e8-4393-8bde-737697963661 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252.0f43a418-9965-4535-bb89-9baa92f5d75c" returned: 0 in 0.753s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fdbece72-52e8-4393-8bde-737697963661 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:29 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252.info Jul 08 01:29:29 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:30 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ba9daabf-92d8-41e3-ba24-4dc89ea0a84a tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-da98783a-c89e-471c-aebb-dadf30f0b32b" returned: 0 in 0.670s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:30 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ba9daabf-92d8-41e3-ba24-4dc89ea0a84a tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-da98783a-c89e-471c-aebb-dadf30f0b32b" released by "delete_volume" :: held 1.620s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:30 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-ba9daabf-92d8-41e3-ba24-4dc89ea0a84a tempest-ProjectMemberTests-945597890 None] Created reservations ['f965ec32-4116-45dc-985b-536e5e386c88', '3249c004-7105-47b9-b75f-c298cba3b2a7', '642a3540-3990-4a77-9c29-1f6b85ec3eeb', '58dcbe7e-a50c-4c96-8587-251f86471484'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:29:30 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fdbece72-52e8-4393-8bde-737697963661 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252.info" returned: 0 in 0.654s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:30 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-fdbece72-52e8-4393-8bde-737697963661 tempest-ProjectReaderTests-531722253 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252.info is being set with open permissions: ugo+rw Jul 08 01:29:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fdbece72-52e8-4393-8bde-737697963661 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ba9daabf-92d8-41e3-ba24-4dc89ea0a84a tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ba9daabf-92d8-41e3-ba24-4dc89ea0a84a tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:30 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ba9daabf-92d8-41e3-ba24-4dc89ea0a84a tempest-ProjectMemberTests-945597890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:30 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ba9daabf-92d8-41e3-ba24-4dc89ea0a84a tempest-ProjectMemberTests-945597890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ba9daabf-92d8-41e3-ba24-4dc89ea0a84a tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ba9daabf-92d8-41e3-ba24-4dc89ea0a84a tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:30 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252.info Jul 08 01:29:30 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:30 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:29:30 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:30 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ba9daabf-92d8-41e3-ba24-4dc89ea0a84a tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.671s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:30 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-ba9daabf-92d8-41e3-ba24-4dc89ea0a84a tempest-ProjectMemberTests-945597890 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:29:30 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-ba9daabf-92d8-41e3-ba24-4dc89ea0a84a tempest-ProjectMemberTests-945597890 None] Deleted volume successfully. Jul 08 01:29:30 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-fdbece72-52e8-4393-8bde-737697963661 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252.info" returned: 0 in 0.715s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-fdbece72-52e8-4393-8bde-737697963661 tempest-ProjectReaderTests-531722253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.744s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ba9daabf-92d8-41e3-ba24-4dc89ea0a84a tempest-ProjectMemberTests-945597890 None] Lock "cinder-da98783a-c89e-471c-aebb-dadf30f0b32b-delete_volume" released by "delete_volume" :: held 2.549s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:31 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-fdbece72-52e8-4393-8bde-737697963661 tempest-ProjectReaderTests-531722253 None] Create snapshot completed successfully Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Flow 'volume_create_manager' (662540c6-2349-4a2e-ade1-a4cf85895bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e253b5e8-6d60-4ac3-8aa9-c141350da883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e253b5e8-6d60-4ac3-8aa9-c141350da883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1678321680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d7527c-2009-4f69-94bd-ae3947ec7916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043a2938932846aa9a07c898bce15405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:31Z,use_quota=True,user_id='a3976431e3344a96ad536addcf6110bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9ee7bd-bab8-4ac6-995b-93a4ce564241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9ee7bd-bab8-4ac6-995b-93a4ce564241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee97c119-cf89-4d21-b9fd-29fb21d0813e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee97c119-cf89-4d21-b9fd-29fb21d0813e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22d7527c-2009-4f69-94bd-ae3947ec7916', 'volume_name': 'volume-22d7527c-2009-4f69-94bd-ae3947ec7916', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b01ebd-542c-40fb-b0b1-c84622abf5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b01ebd-542c-40fb-b0b1-c84622abf5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a8d4a7e-edd8-42c8-bc20-4b36aaea3c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:31 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Volume 22d7527c-2009-4f69-94bd-ae3947ec7916: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22d7527c-2009-4f69-94bd-ae3947ec7916', 'volume_size': 1} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1678321680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d7527c-2009-4f69-94bd-ae3947ec7916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043a2938932846aa9a07c898bce15405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:31Z,use_quota=True,user_id='a3976431e3344a96ad536addcf6110bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Creating volume 22d7527c-2009-4f69-94bd-ae3947ec7916 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:29:31 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:31 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916 1073741824 Jul 08 01:29:31 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3484bb11-19a2-4f20-8ab5-dd9194d8a1b4 tempest-ProjectReaderTests-531722253 None] Acquiring lock "cinder-0f43a418-9965-4535-bb89-9baa92f5d75c-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3484bb11-19a2-4f20-8ab5-dd9194d8a1b4 tempest-ProjectReaderTests-531722253 None] Lock "cinder-0f43a418-9965-4535-bb89-9baa92f5d75c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3484bb11-19a2-4f20-8ab5-dd9194d8a1b4 tempest-ProjectReaderTests-531722253 None] Acquiring lock "cinder-quobyte-1337d02d-b46f-4236-998b-ce21d579c252" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3484bb11-19a2-4f20-8ab5-dd9194d8a1b4 tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-1337d02d-b46f-4236-998b-ce21d579c252" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3484bb11-19a2-4f20-8ab5-dd9194d8a1b4 tempest-ProjectReaderTests-531722253 None] Acquiring lock "cinder-quobyte-0f43a418-9965-4535-bb89-9baa92f5d75c" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3484bb11-19a2-4f20-8ab5-dd9194d8a1b4 tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-0f43a418-9965-4535-bb89-9baa92f5d75c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-3484bb11-19a2-4f20-8ab5-dd9194d8a1b4 tempest-ProjectReaderTests-531722253 None] Deleting offline snapshot 0f43a418-9965-4535-bb89-9baa92f5d75c of volume 1337d02d-b46f-4236-998b-ce21d579c252 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-3484bb11-19a2-4f20-8ab5-dd9194d8a1b4 tempest-ProjectReaderTests-531722253 None] snapshot_file for this snap is: volume-1337d02d-b46f-4236-998b-ce21d579c252.0f43a418-9965-4535-bb89-9baa92f5d75c {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[72846d3c-017e-492d-b580-fdee386c43d4]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3484bb11-19a2-4f20-8ab5-dd9194d8a1b4 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252.0f43a418-9965-4535-bb89-9baa92f5d75c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:31 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252.0f43a418-9965-4535-bb89-9baa92f5d75c Jul 08 01:29:31 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:32 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916 1073741824" returned: 0 in 0.853s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:32 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916 Jul 08 01:29:32 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:32 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3484bb11-19a2-4f20-8ab5-dd9194d8a1b4 tempest-ProjectReaderTests-531722253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252.0f43a418-9965-4535-bb89-9baa92f5d75c" returned: 0 in 0.792s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:32 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-3484bb11-19a2-4f20-8ab5-dd9194d8a1b4 tempest-ProjectReaderTests-531722253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1337d02d-b46f-4236-998b-ce21d579c252(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:29:32 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebac553-a298-4cb7-9c8a-c411fd8d08dd]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3484bb11-19a2-4f20-8ab5-dd9194d8a1b4 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:32 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252 Jul 08 01:29:32 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:32 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916" returned: 0 in 0.673s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:32 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:29:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:32 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a8d4a7e-edd8-42c8-bc20-4b36aaea3c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22d7527c-2009-4f69-94bd-ae3947ec7916', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:32 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e3a8d2-24e0-4122-95b7-b9de54d98fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:32 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Volume volume-22d7527c-2009-4f69-94bd-ae3947ec7916 (22d7527c-2009-4f69-94bd-ae3947ec7916): created successfully Jul 08 01:29:32 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e3a8d2-24e0-4122-95b7-b9de54d98fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:32 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Flow 'volume_create_manager' (662540c6-2349-4a2e-ade1-a4cf85895bbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:32 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-89dc1f6e-5410-4b9d-a41a-abb918f1ec72 tempest-ProjectMemberTests-945597890 None] Created volume successfully. Jul 08 01:29:33 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3484bb11-19a2-4f20-8ab5-dd9194d8a1b4 tempest-ProjectReaderTests-531722253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252" returned: 0 in 0.807s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3484bb11-19a2-4f20-8ab5-dd9194d8a1b4 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252.0f43a418-9965-4535-bb89-9baa92f5d75c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:33 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252.0f43a418-9965-4535-bb89-9baa92f5d75c Jul 08 01:29:33 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ab38c199-509e-40e6-905d-a1b671ba4cb0 tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ab38c199-509e-40e6-905d-a1b671ba4cb0 tempest-ProjectMemberTests-945597890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:33 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-ab38c199-509e-40e6-905d-a1b671ba4cb0 tempest-ProjectMemberTests-945597890 None] Creating offline snapshot 50b38425-c19b-4a03-9d54-3db9e6324fd9 of volume 22d7527c-2009-4f69-94bd-ae3947ec7916 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:29:33 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[04010170-c952-43de-b0ab-26cf60b51188]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ab38c199-509e-40e6-905d-a1b671ba4cb0 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:33 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916 Jul 08 01:29:33 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:33 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3484bb11-19a2-4f20-8ab5-dd9194d8a1b4 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252.0f43a418-9965-4535-bb89-9baa92f5d75c" returned: 0 in 0.749s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3484bb11-19a2-4f20-8ab5-dd9194d8a1b4 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252.0f43a418-9965-4535-bb89-9baa92f5d75c {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:33 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252.0f43a418-9965-4535-bb89-9baa92f5d75c Jul 08 01:29:33 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:34 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ab38c199-509e-40e6-905d-a1b671ba4cb0 tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916" returned: 0 in 0.793s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ab38c199-509e-40e6-905d-a1b671ba4cb0 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916.50b38425-c19b-4a03-9d54-3db9e6324fd9 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:34 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916.50b38425-c19b-4a03-9d54-3db9e6324fd9 1G Jul 08 01:29:34 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:34 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3484bb11-19a2-4f20-8ab5-dd9194d8a1b4 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252.0f43a418-9965-4535-bb89-9baa92f5d75c" returned: 0 in 0.662s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:34 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3484bb11-19a2-4f20-8ab5-dd9194d8a1b4 tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-0f43a418-9965-4535-bb89-9baa92f5d75c" released by "_delete_snapshot" :: held 3.107s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:34 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3484bb11-19a2-4f20-8ab5-dd9194d8a1b4 tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-1337d02d-b46f-4236-998b-ce21d579c252" released by "delete_snapshot" :: held 3.128s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:34 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-3484bb11-19a2-4f20-8ab5-dd9194d8a1b4 tempest-ProjectReaderTests-531722253 None] Created reservations ['3c364685-23e9-4845-8314-f8b80dfa3d47', '65482c55-5d4e-4e93-aa1a-1f71cd8203c1', 'f727ff53-8c63-4bfc-8ec7-6062fdc6113c', 'ff723f0d-2216-4485-9479-ca72019862b5'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:29:34 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-3484bb11-19a2-4f20-8ab5-dd9194d8a1b4 tempest-ProjectReaderTests-531722253 None] Delete snapshot completed successfully. Jul 08 01:29:34 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3484bb11-19a2-4f20-8ab5-dd9194d8a1b4 tempest-ProjectReaderTests-531722253 None] Lock "cinder-0f43a418-9965-4535-bb89-9baa92f5d75c-delete_snapshot" released by "delete_snapshot" :: held 3.267s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:35 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ab38c199-509e-40e6-905d-a1b671ba4cb0 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916.50b38425-c19b-4a03-9d54-3db9e6324fd9 1G" returned: 0 in 0.824s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ab38c199-509e-40e6-905d-a1b671ba4cb0 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22d7527c-2009-4f69-94bd-ae3947ec7916 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916.50b38425-c19b-4a03-9d54-3db9e6324fd9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:35 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22d7527c-2009-4f69-94bd-ae3947ec7916 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916.50b38425-c19b-4a03-9d54-3db9e6324fd9 Jul 08 01:29:35 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5278ac9e-36f0-4aaa-9387-1bd861d95b54 tempest-ProjectReaderTests-531722253 None] Acquiring lock "cinder-1337d02d-b46f-4236-998b-ce21d579c252-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5278ac9e-36f0-4aaa-9387-1bd861d95b54 tempest-ProjectReaderTests-531722253 None] Lock "cinder-1337d02d-b46f-4236-998b-ce21d579c252-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5278ac9e-36f0-4aaa-9387-1bd861d95b54 tempest-ProjectReaderTests-531722253 None] Acquiring lock "cinder-quobyte-1337d02d-b46f-4236-998b-ce21d579c252" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5278ac9e-36f0-4aaa-9387-1bd861d95b54 tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-1337d02d-b46f-4236-998b-ce21d579c252" acquired by "delete_volume" :: waited 0.018s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:35 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[327d8742-c5de-4edf-8820-d18b59354bd4]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5278ac9e-36f0-4aaa-9387-1bd861d95b54 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:35 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ab38c199-509e-40e6-905d-a1b671ba4cb0 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22d7527c-2009-4f69-94bd-ae3947ec7916 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916.50b38425-c19b-4a03-9d54-3db9e6324fd9" returned: 0 in 0.753s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:35 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-ab38c199-509e-40e6-905d-a1b671ba4cb0 tempest-ProjectMemberTests-945597890 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916.50b38425-c19b-4a03-9d54-3db9e6324fd9 is being set with open permissions: ugo+rw Jul 08 01:29:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ab38c199-509e-40e6-905d-a1b671ba4cb0 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916.50b38425-c19b-4a03-9d54-3db9e6324fd9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:35 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916.50b38425-c19b-4a03-9d54-3db9e6324fd9 Jul 08 01:29:35 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:35 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252 Jul 08 01:29:35 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:36 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ab38c199-509e-40e6-905d-a1b671ba4cb0 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916.50b38425-c19b-4a03-9d54-3db9e6324fd9" returned: 0 in 0.625s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ab38c199-509e-40e6-905d-a1b671ba4cb0 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:36 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916.info Jul 08 01:29:36 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:36 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5278ac9e-36f0-4aaa-9387-1bd861d95b54 tempest-ProjectReaderTests-531722253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252" returned: 0 in 0.802s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5278ac9e-36f0-4aaa-9387-1bd861d95b54 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:36 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252 Jul 08 01:29:36 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:37 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ab38c199-509e-40e6-905d-a1b671ba4cb0 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916.info" returned: 0 in 0.689s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:37 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-ab38c199-509e-40e6-905d-a1b671ba4cb0 tempest-ProjectMemberTests-945597890 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916.info is being set with open permissions: ugo+rw Jul 08 01:29:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ab38c199-509e-40e6-905d-a1b671ba4cb0 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:37 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916.info Jul 08 01:29:37 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:37 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5278ac9e-36f0-4aaa-9387-1bd861d95b54 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-1337d02d-b46f-4236-998b-ce21d579c252" returned: 0 in 0.662s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:37 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5278ac9e-36f0-4aaa-9387-1bd861d95b54 tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-1337d02d-b46f-4236-998b-ce21d579c252" released by "delete_volume" :: held 1.535s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:37 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-5278ac9e-36f0-4aaa-9387-1bd861d95b54 tempest-ProjectReaderTests-531722253 None] Created reservations ['33482f69-c42a-45e9-b498-9c245aeb1f33', '6c0cfacb-db70-433f-8b4f-2daa380300ec', '4b94f978-efb5-4572-9a46-cacd0714e4c6', 'ec485abf-0b3c-48ce-94bf-1514da34ac4a'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:29:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5278ac9e-36f0-4aaa-9387-1bd861d95b54 tempest-ProjectReaderTests-531722253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5278ac9e-36f0-4aaa-9387-1bd861d95b54 tempest-ProjectReaderTests-531722253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:37 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5278ac9e-36f0-4aaa-9387-1bd861d95b54 tempest-ProjectReaderTests-531722253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:37 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-5278ac9e-36f0-4aaa-9387-1bd861d95b54 tempest-ProjectReaderTests-531722253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-5278ac9e-36f0-4aaa-9387-1bd861d95b54 tempest-ProjectReaderTests-531722253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5278ac9e-36f0-4aaa-9387-1bd861d95b54 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:37 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:29:37 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:37 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ab38c199-509e-40e6-905d-a1b671ba4cb0 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916.info" returned: 0 in 0.653s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ab38c199-509e-40e6-905d-a1b671ba4cb0 tempest-ProjectMemberTests-945597890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.433s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:37 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-ab38c199-509e-40e6-905d-a1b671ba4cb0 tempest-ProjectMemberTests-945597890 None] Create snapshot completed successfully Jul 08 01:29:38 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-5278ac9e-36f0-4aaa-9387-1bd861d95b54 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.682s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-5278ac9e-36f0-4aaa-9387-1bd861d95b54 tempest-ProjectReaderTests-531722253 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:29:38 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-5278ac9e-36f0-4aaa-9387-1bd861d95b54 tempest-ProjectReaderTests-531722253 None] Deleted volume successfully. Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-5278ac9e-36f0-4aaa-9387-1bd861d95b54 tempest-ProjectReaderTests-531722253 None] Lock "cinder-1337d02d-b46f-4236-998b-ce21d579c252-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Flow 'volume_create_manager' (f577391a-a34a-4298-bf0c-459eb246f121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ccfe68-9c3f-4950-82cc-ad7d6436c208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ccfe68-9c3f-4950-82cc-ad7d6436c208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1912772591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c3a18fe-b3b4-4288-9994-1740172f0d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef33caddaf744243b8124f7dd8c4d1e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:38Z,use_quota=True,user_id='b01a5b33fd3a461a963e8aa3700add02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b67ee32e-098c-49a8-92b5-042c3efffb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b67ee32e-098c-49a8-92b5-042c3efffb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd07494c-f85b-4e69-9921-241a1d8ec93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd07494c-f85b-4e69-9921-241a1d8ec93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c3a18fe-b3b4-4288-9994-1740172f0d99', 'volume_name': 'volume-5c3a18fe-b3b4-4288-9994-1740172f0d99', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (118caf72-5d6e-4b66-b784-43ba5cee5bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (118caf72-5d6e-4b66-b784-43ba5cee5bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c902c1-9b89-43f0-90d8-faa44f02aaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:38 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Volume 5c3a18fe-b3b4-4288-9994-1740172f0d99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c3a18fe-b3b4-4288-9994-1740172f0d99', 'volume_size': 1} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1912772591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c3a18fe-b3b4-4288-9994-1740172f0d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef33caddaf744243b8124f7dd8c4d1e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:38Z,use_quota=True,user_id='b01a5b33fd3a461a963e8aa3700add02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Creating volume 5c3a18fe-b3b4-4288-9994-1740172f0d99 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:29:38 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:38 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99 1073741824 Jul 08 01:29:38 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-797cbc75-0daa-4603-88e2-645265ce61ad tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-50b38425-c19b-4a03-9d54-3db9e6324fd9-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-797cbc75-0daa-4603-88e2-645265ce61ad tempest-ProjectMemberTests-945597890 None] Lock "cinder-50b38425-c19b-4a03-9d54-3db9e6324fd9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-797cbc75-0daa-4603-88e2-645265ce61ad tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-quobyte-22d7527c-2009-4f69-94bd-ae3947ec7916" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-797cbc75-0daa-4603-88e2-645265ce61ad tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-22d7527c-2009-4f69-94bd-ae3947ec7916" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-797cbc75-0daa-4603-88e2-645265ce61ad tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-quobyte-50b38425-c19b-4a03-9d54-3db9e6324fd9" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-797cbc75-0daa-4603-88e2-645265ce61ad tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-50b38425-c19b-4a03-9d54-3db9e6324fd9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-797cbc75-0daa-4603-88e2-645265ce61ad tempest-ProjectMemberTests-945597890 None] Deleting offline snapshot 50b38425-c19b-4a03-9d54-3db9e6324fd9 of volume 22d7527c-2009-4f69-94bd-ae3947ec7916 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-797cbc75-0daa-4603-88e2-645265ce61ad tempest-ProjectMemberTests-945597890 None] snapshot_file for this snap is: volume-22d7527c-2009-4f69-94bd-ae3947ec7916.50b38425-c19b-4a03-9d54-3db9e6324fd9 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b740dc47-7f28-4788-8228-d66643718711]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-797cbc75-0daa-4603-88e2-645265ce61ad tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916.50b38425-c19b-4a03-9d54-3db9e6324fd9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:38 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916.50b38425-c19b-4a03-9d54-3db9e6324fd9 Jul 08 01:29:38 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:39 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99 1073741824" returned: 0 in 0.900s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:39 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99 Jul 08 01:29:39 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:39 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-797cbc75-0daa-4603-88e2-645265ce61ad tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916.50b38425-c19b-4a03-9d54-3db9e6324fd9" returned: 0 in 0.798s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:39 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-797cbc75-0daa-4603-88e2-645265ce61ad tempest-ProjectMemberTests-945597890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22d7527c-2009-4f69-94bd-ae3947ec7916(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:29:39 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b09f91b-b101-49b9-be23-ff721f1a42ab]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-797cbc75-0daa-4603-88e2-645265ce61ad tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:39 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916 Jul 08 01:29:39 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:40 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99" returned: 0 in 0.675s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:40 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:29:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c902c1-9b89-43f0-90d8-faa44f02aaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c3a18fe-b3b4-4288-9994-1740172f0d99', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b7cca5d-cb75-48cb-bace-68269eba6bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:40 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Volume volume-5c3a18fe-b3b4-4288-9994-1740172f0d99 (5c3a18fe-b3b4-4288-9994-1740172f0d99): created successfully Jul 08 01:29:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b7cca5d-cb75-48cb-bace-68269eba6bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:40 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Flow 'volume_create_manager' (f577391a-a34a-4298-bf0c-459eb246f121) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:40 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-8e910ff0-5481-4781-ace4-1cecd238b752 tempest-ProjectReaderTests-531722253 None] Created volume successfully. Jul 08 01:29:40 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-797cbc75-0daa-4603-88e2-645265ce61ad tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916" returned: 0 in 0.870s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-797cbc75-0daa-4603-88e2-645265ce61ad tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916.50b38425-c19b-4a03-9d54-3db9e6324fd9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:40 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916.50b38425-c19b-4a03-9d54-3db9e6324fd9 Jul 08 01:29:40 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e3632d93-cc71-4b36-913e-763060836a9e tempest-ProjectReaderTests-531722253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e3632d93-cc71-4b36-913e-763060836a9e tempest-ProjectReaderTests-531722253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:40 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-e3632d93-cc71-4b36-913e-763060836a9e tempest-ProjectReaderTests-531722253 None] Creating offline snapshot 4a7ede5d-f601-429e-bf60-1564de2913ed of volume 5c3a18fe-b3b4-4288-9994-1740172f0d99 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:29:40 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af087ee-3ba5-4132-bade-4a8a829b2cad]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3632d93-cc71-4b36-913e-763060836a9e tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:40 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99 Jul 08 01:29:40 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:41 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-797cbc75-0daa-4603-88e2-645265ce61ad tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916.50b38425-c19b-4a03-9d54-3db9e6324fd9" returned: 0 in 0.741s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-797cbc75-0daa-4603-88e2-645265ce61ad tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916.50b38425-c19b-4a03-9d54-3db9e6324fd9 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:41 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916.50b38425-c19b-4a03-9d54-3db9e6324fd9 Jul 08 01:29:41 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:41 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3632d93-cc71-4b36-913e-763060836a9e tempest-ProjectReaderTests-531722253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99" returned: 0 in 0.806s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3632d93-cc71-4b36-913e-763060836a9e tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99.4a7ede5d-f601-429e-bf60-1564de2913ed 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:41 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99.4a7ede5d-f601-429e-bf60-1564de2913ed 1G Jul 08 01:29:41 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:41 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-797cbc75-0daa-4603-88e2-645265ce61ad tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916.50b38425-c19b-4a03-9d54-3db9e6324fd9" returned: 0 in 0.641s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:41 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-797cbc75-0daa-4603-88e2-645265ce61ad tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-50b38425-c19b-4a03-9d54-3db9e6324fd9" released by "_delete_snapshot" :: held 3.143s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:41 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-797cbc75-0daa-4603-88e2-645265ce61ad tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-22d7527c-2009-4f69-94bd-ae3947ec7916" released by "delete_snapshot" :: held 3.169s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:41 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-797cbc75-0daa-4603-88e2-645265ce61ad tempest-ProjectMemberTests-945597890 None] Created reservations ['e9a5c8f2-d16e-44f5-ae3a-91e09ce7bfd4', '33eef5aa-afd3-49ce-b1ab-5e2d2a2da99a', 'b59080b3-8633-4807-8f9c-9dd0f5e88e20', '436fd087-86a2-465c-8601-acc8be8e343a'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:29:42 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-797cbc75-0daa-4603-88e2-645265ce61ad tempest-ProjectMemberTests-945597890 None] Delete snapshot completed successfully. Jul 08 01:29:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-797cbc75-0daa-4603-88e2-645265ce61ad tempest-ProjectMemberTests-945597890 None] Lock "cinder-50b38425-c19b-4a03-9d54-3db9e6324fd9-delete_snapshot" released by "delete_snapshot" :: held 3.294s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:42 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3632d93-cc71-4b36-913e-763060836a9e tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99.4a7ede5d-f601-429e-bf60-1564de2913ed 1G" returned: 0 in 0.846s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3632d93-cc71-4b36-913e-763060836a9e tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c3a18fe-b3b4-4288-9994-1740172f0d99 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99.4a7ede5d-f601-429e-bf60-1564de2913ed {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:42 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c3a18fe-b3b4-4288-9994-1740172f0d99 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99.4a7ede5d-f601-429e-bf60-1564de2913ed Jul 08 01:29:42 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-98002279-3c6d-4a0d-a592-b94cc6fb76d8 tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-22d7527c-2009-4f69-94bd-ae3947ec7916-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-98002279-3c6d-4a0d-a592-b94cc6fb76d8 tempest-ProjectMemberTests-945597890 None] Lock "cinder-22d7527c-2009-4f69-94bd-ae3947ec7916-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-98002279-3c6d-4a0d-a592-b94cc6fb76d8 tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-quobyte-22d7527c-2009-4f69-94bd-ae3947ec7916" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:42 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-98002279-3c6d-4a0d-a592-b94cc6fb76d8 tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-22d7527c-2009-4f69-94bd-ae3947ec7916" acquired by "delete_volume" :: waited 0.019s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:43 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[74acdba4-1ab9-48d0-8754-457491b36b80]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-98002279-3c6d-4a0d-a592-b94cc6fb76d8 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:43 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3632d93-cc71-4b36-913e-763060836a9e tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c3a18fe-b3b4-4288-9994-1740172f0d99 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99.4a7ede5d-f601-429e-bf60-1564de2913ed" returned: 0 in 0.752s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:43 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-e3632d93-cc71-4b36-913e-763060836a9e tempest-ProjectReaderTests-531722253 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99.4a7ede5d-f601-429e-bf60-1564de2913ed is being set with open permissions: ugo+rw Jul 08 01:29:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3632d93-cc71-4b36-913e-763060836a9e tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99.4a7ede5d-f601-429e-bf60-1564de2913ed {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:43 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916 Jul 08 01:29:43 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:43 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99.4a7ede5d-f601-429e-bf60-1564de2913ed Jul 08 01:29:43 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:43 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3632d93-cc71-4b36-913e-763060836a9e tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99.4a7ede5d-f601-429e-bf60-1564de2913ed" returned: 0 in 0.668s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:43 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-98002279-3c6d-4a0d-a592-b94cc6fb76d8 tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916" returned: 0 in 0.786s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-98002279-3c6d-4a0d-a592-b94cc6fb76d8 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3632d93-cc71-4b36-913e-763060836a9e tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:43 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916 Jul 08 01:29:43 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:43 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99.info Jul 08 01:29:43 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:44 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-98002279-3c6d-4a0d-a592-b94cc6fb76d8 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-22d7527c-2009-4f69-94bd-ae3947ec7916" returned: 0 in 0.639s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:44 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-98002279-3c6d-4a0d-a592-b94cc6fb76d8 tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-22d7527c-2009-4f69-94bd-ae3947ec7916" released by "delete_volume" :: held 1.500s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:44 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3632d93-cc71-4b36-913e-763060836a9e tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99.info" returned: 0 in 0.661s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:44 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-e3632d93-cc71-4b36-913e-763060836a9e tempest-ProjectReaderTests-531722253 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99.info is being set with open permissions: ugo+rw Jul 08 01:29:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3632d93-cc71-4b36-913e-763060836a9e tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:44 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99.info Jul 08 01:29:44 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:44 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-98002279-3c6d-4a0d-a592-b94cc6fb76d8 tempest-ProjectMemberTests-945597890 None] Created reservations ['68ed397b-3a3e-418a-8d52-c5a055dad0ce', 'a031caa7-7bc6-4ae4-af02-cc8973941a2b', '77ef1162-0393-4980-b20b-79b1b0860493', '1379bc17-aca6-4020-8732-3371f120ad61'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:29:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-98002279-3c6d-4a0d-a592-b94cc6fb76d8 tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-98002279-3c6d-4a0d-a592-b94cc6fb76d8 tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-98002279-3c6d-4a0d-a592-b94cc6fb76d8 tempest-ProjectMemberTests-945597890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-98002279-3c6d-4a0d-a592-b94cc6fb76d8 tempest-ProjectMemberTests-945597890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-98002279-3c6d-4a0d-a592-b94cc6fb76d8 tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-98002279-3c6d-4a0d-a592-b94cc6fb76d8 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:44 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:29:44 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:45 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e3632d93-cc71-4b36-913e-763060836a9e tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99.info" returned: 0 in 0.674s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e3632d93-cc71-4b36-913e-763060836a9e tempest-ProjectReaderTests-531722253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.517s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:45 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-e3632d93-cc71-4b36-913e-763060836a9e tempest-ProjectReaderTests-531722253 None] Create snapshot completed successfully Jul 08 01:29:45 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-98002279-3c6d-4a0d-a592-b94cc6fb76d8 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.676s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-98002279-3c6d-4a0d-a592-b94cc6fb76d8 tempest-ProjectMemberTests-945597890 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:29:45 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-98002279-3c6d-4a0d-a592-b94cc6fb76d8 tempest-ProjectMemberTests-945597890 None] Deleted volume successfully. Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-98002279-3c6d-4a0d-a592-b94cc6fb76d8 tempest-ProjectMemberTests-945597890 None] Lock "cinder-22d7527c-2009-4f69-94bd-ae3947ec7916-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:45 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:29:45 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Flow 'volume_create_manager' (18ac0124-7e74-4c3a-b0a7-0375682c7532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe4f8dc9-4570-4ea9-9f5d-72b90e86c292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe4f8dc9-4570-4ea9-9f5d-72b90e86c292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-440579450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=747f09d5-26a0-4e5a-ab91-95d88ce321d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043a2938932846aa9a07c898bce15405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:46Z,use_quota=True,user_id='a3976431e3344a96ad536addcf6110bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9b28379-f263-4e27-ba43-0bc7a149e56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9b28379-f263-4e27-ba43-0bc7a149e56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4e3b03-a6aa-47e8-857a-eb063aa6a5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4e3b03-a6aa-47e8-857a-eb063aa6a5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '747f09d5-26a0-4e5a-ab91-95d88ce321d3', 'volume_name': 'volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17395f6-79f3-4d26-8c08-2f8dcbdf59cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17395f6-79f3-4d26-8c08-2f8dcbdf59cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f748b88f-95cd-49b9-97eb-8652c5f4658c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:45 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Volume 747f09d5-26a0-4e5a-ab91-95d88ce321d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3', 'volume_size': 1} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-440579450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=747f09d5-26a0-4e5a-ab91-95d88ce321d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043a2938932846aa9a07c898bce15405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:46Z,use_quota=True,user_id='a3976431e3344a96ad536addcf6110bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Creating volume 747f09d5-26a0-4e5a-ab91-95d88ce321d3 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:29:45 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:45 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3 1073741824 Jul 08 01:29:45 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8c564b10-c200-4548-91ba-f229b2955e2d tempest-ProjectReaderTests-531722253 None] Acquiring lock "cinder-4a7ede5d-f601-429e-bf60-1564de2913ed-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8c564b10-c200-4548-91ba-f229b2955e2d tempest-ProjectReaderTests-531722253 None] Lock "cinder-4a7ede5d-f601-429e-bf60-1564de2913ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8c564b10-c200-4548-91ba-f229b2955e2d tempest-ProjectReaderTests-531722253 None] Acquiring lock "cinder-quobyte-5c3a18fe-b3b4-4288-9994-1740172f0d99" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8c564b10-c200-4548-91ba-f229b2955e2d tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-5c3a18fe-b3b4-4288-9994-1740172f0d99" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8c564b10-c200-4548-91ba-f229b2955e2d tempest-ProjectReaderTests-531722253 None] Acquiring lock "cinder-quobyte-4a7ede5d-f601-429e-bf60-1564de2913ed" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8c564b10-c200-4548-91ba-f229b2955e2d tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-4a7ede5d-f601-429e-bf60-1564de2913ed" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-8c564b10-c200-4548-91ba-f229b2955e2d tempest-ProjectReaderTests-531722253 None] Deleting offline snapshot 4a7ede5d-f601-429e-bf60-1564de2913ed of volume 5c3a18fe-b3b4-4288-9994-1740172f0d99 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-8c564b10-c200-4548-91ba-f229b2955e2d tempest-ProjectReaderTests-531722253 None] snapshot_file for this snap is: volume-5c3a18fe-b3b4-4288-9994-1740172f0d99.4a7ede5d-f601-429e-bf60-1564de2913ed {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:29:45 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28a5f70-f537-4c51-8057-a1579ef2741d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8c564b10-c200-4548-91ba-f229b2955e2d tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99.4a7ede5d-f601-429e-bf60-1564de2913ed {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:46 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.678s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:46 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:29:46 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:29:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread count: 28 {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:29:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread info: [<_MainThread(MainThread, started 134382216167552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:29:46 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99.4a7ede5d-f601-429e-bf60-1564de2913ed Jul 08 01:29:46 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:46 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3 1073741824" returned: 0 in 0.929s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:46 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3 Jul 08 01:29:46 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:46 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8c564b10-c200-4548-91ba-f229b2955e2d tempest-ProjectReaderTests-531722253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99.4a7ede5d-f601-429e-bf60-1564de2913ed" returned: 0 in 0.866s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:46 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-8c564b10-c200-4548-91ba-f229b2955e2d tempest-ProjectReaderTests-531722253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c3a18fe-b3b4-4288-9994-1740172f0d99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:29:46 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0154e7-b33f-45f3-a007-9ccbeb4e517f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8c564b10-c200-4548-91ba-f229b2955e2d tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:47 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99 Jul 08 01:29:47 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:47 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3" returned: 0 in 0.646s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:47 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:29:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:47 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f748b88f-95cd-49b9-97eb-8652c5f4658c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:47 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc018bf3-9e47-4fe7-92b0-4db1292b46d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:47 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Volume volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3 (747f09d5-26a0-4e5a-ab91-95d88ce321d3): created successfully Jul 08 01:29:47 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc018bf3-9e47-4fe7-92b0-4db1292b46d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:47 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Flow 'volume_create_manager' (18ac0124-7e74-4c3a-b0a7-0375682c7532) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:47 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-9c144bf0-0637-472c-b1e2-c4067446bd5e tempest-ProjectMemberTests-945597890 None] Created volume successfully. Jul 08 01:29:47 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8c564b10-c200-4548-91ba-f229b2955e2d tempest-ProjectReaderTests-531722253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99" returned: 0 in 0.776s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8c564b10-c200-4548-91ba-f229b2955e2d tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99.4a7ede5d-f601-429e-bf60-1564de2913ed {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:47 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99.4a7ede5d-f601-429e-bf60-1564de2913ed Jul 08 01:29:47 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-085f5c67-2dea-4ff5-89fb-0b14d28569ce tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-085f5c67-2dea-4ff5-89fb-0b14d28569ce tempest-ProjectMemberTests-945597890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:47 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-085f5c67-2dea-4ff5-89fb-0b14d28569ce tempest-ProjectMemberTests-945597890 None] Creating offline snapshot a816ab01-f3db-4a95-8894-f8b9eb8d2cf8 of volume 747f09d5-26a0-4e5a-ab91-95d88ce321d3 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:29:47 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdd9639-1280-4456-9c3d-42025953e0e8]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-085f5c67-2dea-4ff5-89fb-0b14d28569ce tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:47 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3 Jul 08 01:29:47 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:48 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8c564b10-c200-4548-91ba-f229b2955e2d tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99.4a7ede5d-f601-429e-bf60-1564de2913ed" returned: 0 in 0.731s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8c564b10-c200-4548-91ba-f229b2955e2d tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99.4a7ede5d-f601-429e-bf60-1564de2913ed {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:48 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99.4a7ede5d-f601-429e-bf60-1564de2913ed Jul 08 01:29:48 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:48 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-085f5c67-2dea-4ff5-89fb-0b14d28569ce tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3" returned: 0 in 0.767s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-085f5c67-2dea-4ff5-89fb-0b14d28569ce tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3.a816ab01-f3db-4a95-8894-f8b9eb8d2cf8 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:48 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3.a816ab01-f3db-4a95-8894-f8b9eb8d2cf8 1G Jul 08 01:29:48 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:49 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-8c564b10-c200-4548-91ba-f229b2955e2d tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99.4a7ede5d-f601-429e-bf60-1564de2913ed" returned: 0 in 0.681s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:49 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8c564b10-c200-4548-91ba-f229b2955e2d tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-4a7ede5d-f601-429e-bf60-1564de2913ed" released by "_delete_snapshot" :: held 3.172s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:49 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8c564b10-c200-4548-91ba-f229b2955e2d tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-5c3a18fe-b3b4-4288-9994-1740172f0d99" released by "delete_snapshot" :: held 3.194s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:49 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-8c564b10-c200-4548-91ba-f229b2955e2d tempest-ProjectReaderTests-531722253 None] Created reservations ['f8f88064-d41e-4050-943d-b27b149935ad', '47d19b30-2509-4271-86f5-553459777dea', '7931cc91-8811-4b25-a365-3c29fc89d29c', '34ec8de4-853e-4f3b-9147-540405629b36'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:29:49 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-8c564b10-c200-4548-91ba-f229b2955e2d tempest-ProjectReaderTests-531722253 None] Delete snapshot completed successfully. Jul 08 01:29:49 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-8c564b10-c200-4548-91ba-f229b2955e2d tempest-ProjectReaderTests-531722253 None] Lock "cinder-4a7ede5d-f601-429e-bf60-1564de2913ed-delete_snapshot" released by "delete_snapshot" :: held 3.350s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:49 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-085f5c67-2dea-4ff5-89fb-0b14d28569ce tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3.a816ab01-f3db-4a95-8894-f8b9eb8d2cf8 1G" returned: 0 in 0.810s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-085f5c67-2dea-4ff5-89fb-0b14d28569ce tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3.a816ab01-f3db-4a95-8894-f8b9eb8d2cf8 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:49 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3.a816ab01-f3db-4a95-8894-f8b9eb8d2cf8 Jul 08 01:29:49 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b5a2c8cc-8494-430e-8bf6-07447303b164 tempest-ProjectReaderTests-531722253 None] Acquiring lock "cinder-5c3a18fe-b3b4-4288-9994-1740172f0d99-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b5a2c8cc-8494-430e-8bf6-07447303b164 tempest-ProjectReaderTests-531722253 None] Lock "cinder-5c3a18fe-b3b4-4288-9994-1740172f0d99-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:50 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-085f5c67-2dea-4ff5-89fb-0b14d28569ce tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3.a816ab01-f3db-4a95-8894-f8b9eb8d2cf8" returned: 0 in 0.747s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:50 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-085f5c67-2dea-4ff5-89fb-0b14d28569ce tempest-ProjectMemberTests-945597890 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3.a816ab01-f3db-4a95-8894-f8b9eb8d2cf8 is being set with open permissions: ugo+rw Jul 08 01:29:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-085f5c67-2dea-4ff5-89fb-0b14d28569ce tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3.a816ab01-f3db-4a95-8894-f8b9eb8d2cf8 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:50 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3.a816ab01-f3db-4a95-8894-f8b9eb8d2cf8 Jul 08 01:29:50 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b5a2c8cc-8494-430e-8bf6-07447303b164 tempest-ProjectReaderTests-531722253 None] Acquiring lock "cinder-quobyte-5c3a18fe-b3b4-4288-9994-1740172f0d99" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b5a2c8cc-8494-430e-8bf6-07447303b164 tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-5c3a18fe-b3b4-4288-9994-1740172f0d99" acquired by "delete_volume" :: waited 0.022s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:50 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6696f1-77f7-432f-a8cc-ba4eb5c953fb]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b5a2c8cc-8494-430e-8bf6-07447303b164 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:50 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99 Jul 08 01:29:50 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:50 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-085f5c67-2dea-4ff5-89fb-0b14d28569ce tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3.a816ab01-f3db-4a95-8894-f8b9eb8d2cf8" returned: 0 in 0.707s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-085f5c67-2dea-4ff5-89fb-0b14d28569ce tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:50 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3.info Jul 08 01:29:50 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:51 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b5a2c8cc-8494-430e-8bf6-07447303b164 tempest-ProjectReaderTests-531722253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99" returned: 0 in 0.812s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b5a2c8cc-8494-430e-8bf6-07447303b164 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:51 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99 Jul 08 01:29:51 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:51 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-085f5c67-2dea-4ff5-89fb-0b14d28569ce tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3.info" returned: 0 in 0.654s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:51 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-085f5c67-2dea-4ff5-89fb-0b14d28569ce tempest-ProjectMemberTests-945597890 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3.info is being set with open permissions: ugo+rw Jul 08 01:29:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-085f5c67-2dea-4ff5-89fb-0b14d28569ce tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:51 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3.info Jul 08 01:29:51 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:51 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b5a2c8cc-8494-430e-8bf6-07447303b164 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-5c3a18fe-b3b4-4288-9994-1740172f0d99" returned: 0 in 0.673s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:51 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b5a2c8cc-8494-430e-8bf6-07447303b164 tempest-ProjectReaderTests-531722253 None] Lock "cinder-quobyte-5c3a18fe-b3b4-4288-9994-1740172f0d99" released by "delete_volume" :: held 1.562s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:51 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-b5a2c8cc-8494-430e-8bf6-07447303b164 tempest-ProjectReaderTests-531722253 None] Created reservations ['5185f4a1-6c88-4a8a-8a67-26511eb3c1d4', 'fd3af239-cfab-4a0e-8bf5-6b8f78a42926', '8a2e433d-a5aa-4dbf-9a08-6819e9f39bcb', '16062968-f87a-4e66-9d14-6feb22f083ba'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:29:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b5a2c8cc-8494-430e-8bf6-07447303b164 tempest-ProjectReaderTests-531722253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b5a2c8cc-8494-430e-8bf6-07447303b164 tempest-ProjectReaderTests-531722253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:51 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b5a2c8cc-8494-430e-8bf6-07447303b164 tempest-ProjectReaderTests-531722253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:51 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-b5a2c8cc-8494-430e-8bf6-07447303b164 tempest-ProjectReaderTests-531722253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-b5a2c8cc-8494-430e-8bf6-07447303b164 tempest-ProjectReaderTests-531722253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b5a2c8cc-8494-430e-8bf6-07447303b164 tempest-ProjectReaderTests-531722253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:52 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:29:52 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:52 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-085f5c67-2dea-4ff5-89fb-0b14d28569ce tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3.info" returned: 0 in 0.659s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-085f5c67-2dea-4ff5-89fb-0b14d28569ce tempest-ProjectMemberTests-945597890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.439s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:52 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-085f5c67-2dea-4ff5-89fb-0b14d28569ce tempest-ProjectMemberTests-945597890 None] Create snapshot completed successfully Jul 08 01:29:52 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b5a2c8cc-8494-430e-8bf6-07447303b164 tempest-ProjectReaderTests-531722253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.684s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:52 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-b5a2c8cc-8494-430e-8bf6-07447303b164 tempest-ProjectReaderTests-531722253 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:29:52 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-b5a2c8cc-8494-430e-8bf6-07447303b164 tempest-ProjectReaderTests-531722253 None] Deleted volume successfully. Jul 08 01:29:52 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b5a2c8cc-8494-430e-8bf6-07447303b164 tempest-ProjectReaderTests-531722253 None] Lock "cinder-5c3a18fe-b3b4-4288-9994-1740172f0d99-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:53 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-def2fb27-9032-4840-b0ad-e5fae48c298f tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-a816ab01-f3db-4a95-8894-f8b9eb8d2cf8-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:53 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-def2fb27-9032-4840-b0ad-e5fae48c298f tempest-ProjectMemberTests-945597890 None] Lock "cinder-a816ab01-f3db-4a95-8894-f8b9eb8d2cf8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:53 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-def2fb27-9032-4840-b0ad-e5fae48c298f tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-quobyte-747f09d5-26a0-4e5a-ab91-95d88ce321d3" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:53 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-def2fb27-9032-4840-b0ad-e5fae48c298f tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-747f09d5-26a0-4e5a-ab91-95d88ce321d3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:53 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-def2fb27-9032-4840-b0ad-e5fae48c298f tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-quobyte-a816ab01-f3db-4a95-8894-f8b9eb8d2cf8" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:53 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-def2fb27-9032-4840-b0ad-e5fae48c298f tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-a816ab01-f3db-4a95-8894-f8b9eb8d2cf8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:53 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-def2fb27-9032-4840-b0ad-e5fae48c298f tempest-ProjectMemberTests-945597890 None] Deleting offline snapshot a816ab01-f3db-4a95-8894-f8b9eb8d2cf8 of volume 747f09d5-26a0-4e5a-ab91-95d88ce321d3 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:29:53 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-def2fb27-9032-4840-b0ad-e5fae48c298f tempest-ProjectMemberTests-945597890 None] snapshot_file for this snap is: volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3.a816ab01-f3db-4a95-8894-f8b9eb8d2cf8 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:29:53 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd4b411-2a54-4be5-b51e-665577dda6d2]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-def2fb27-9032-4840-b0ad-e5fae48c298f tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3.a816ab01-f3db-4a95-8894-f8b9eb8d2cf8 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:53 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3.a816ab01-f3db-4a95-8894-f8b9eb8d2cf8 Jul 08 01:29:53 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:54 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-def2fb27-9032-4840-b0ad-e5fae48c298f tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3.a816ab01-f3db-4a95-8894-f8b9eb8d2cf8" returned: 0 in 0.867s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:54 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-def2fb27-9032-4840-b0ad-e5fae48c298f tempest-ProjectMemberTests-945597890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:29:54 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d023e065-2d5e-416d-99ba-a5a2e3148be9]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-def2fb27-9032-4840-b0ad-e5fae48c298f tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:54 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3 Jul 08 01:29:54 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:54 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-def2fb27-9032-4840-b0ad-e5fae48c298f tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3" returned: 0 in 0.831s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-def2fb27-9032-4840-b0ad-e5fae48c298f tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3.a816ab01-f3db-4a95-8894-f8b9eb8d2cf8 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:54 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3.a816ab01-f3db-4a95-8894-f8b9eb8d2cf8 Jul 08 01:29:54 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:55 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-def2fb27-9032-4840-b0ad-e5fae48c298f tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3.a816ab01-f3db-4a95-8894-f8b9eb8d2cf8" returned: 0 in 0.777s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-def2fb27-9032-4840-b0ad-e5fae48c298f tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3.a816ab01-f3db-4a95-8894-f8b9eb8d2cf8 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:55 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3.a816ab01-f3db-4a95-8894-f8b9eb8d2cf8 Jul 08 01:29:55 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:56 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-def2fb27-9032-4840-b0ad-e5fae48c298f tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3.a816ab01-f3db-4a95-8894-f8b9eb8d2cf8" returned: 0 in 0.746s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-def2fb27-9032-4840-b0ad-e5fae48c298f tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-a816ab01-f3db-4a95-8894-f8b9eb8d2cf8" released by "_delete_snapshot" :: held 3.327s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-def2fb27-9032-4840-b0ad-e5fae48c298f tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-747f09d5-26a0-4e5a-ab91-95d88ce321d3" released by "delete_snapshot" :: held 3.351s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:56 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-def2fb27-9032-4840-b0ad-e5fae48c298f tempest-ProjectMemberTests-945597890 None] Created reservations ['a3ee4c60-10b1-45ad-b9e5-3cafbe40fb1d', '129d5635-8305-4428-9fe6-de5ec57927ed', 'e9fde596-45a3-4c12-a4ed-42c3f93505a7', '7c6fd8d5-a0d0-40ff-b81d-9dc3aa4ea24b'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:29:56 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-def2fb27-9032-4840-b0ad-e5fae48c298f tempest-ProjectMemberTests-945597890 None] Delete snapshot completed successfully. Jul 08 01:29:56 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-def2fb27-9032-4840-b0ad-e5fae48c298f tempest-ProjectMemberTests-945597890 None] Lock "cinder-a816ab01-f3db-4a95-8894-f8b9eb8d2cf8-delete_snapshot" released by "delete_snapshot" :: held 3.500s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:57 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bf609401-f52c-4771-b379-d53522ba4d2c tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-747f09d5-26a0-4e5a-ab91-95d88ce321d3-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:57 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bf609401-f52c-4771-b379-d53522ba4d2c tempest-ProjectMemberTests-945597890 None] Lock "cinder-747f09d5-26a0-4e5a-ab91-95d88ce321d3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:57 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bf609401-f52c-4771-b379-d53522ba4d2c tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-quobyte-747f09d5-26a0-4e5a-ab91-95d88ce321d3" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:57 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bf609401-f52c-4771-b379-d53522ba4d2c tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-747f09d5-26a0-4e5a-ab91-95d88ce321d3" acquired by "delete_volume" :: waited 0.016s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:57 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1ab8c1-baca-47a8-a4cf-d26053548587]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bf609401-f52c-4771-b379-d53522ba4d2c tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:57 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3 Jul 08 01:29:57 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:58 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bf609401-f52c-4771-b379-d53522ba4d2c tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3" returned: 0 in 0.829s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bf609401-f52c-4771-b379-d53522ba4d2c tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:58 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3 Jul 08 01:29:58 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:59 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bf609401-f52c-4771-b379-d53522ba4d2c tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-747f09d5-26a0-4e5a-ab91-95d88ce321d3" returned: 0 in 0.632s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:59 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bf609401-f52c-4771-b379-d53522ba4d2c tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-747f09d5-26a0-4e5a-ab91-95d88ce321d3" released by "delete_volume" :: held 1.529s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:59 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-bf609401-f52c-4771-b379-d53522ba4d2c tempest-ProjectMemberTests-945597890 None] Created reservations ['934abe5c-e8b8-45f8-b594-46add0cc1012', '40d758db-5398-467f-9b8c-345caad5e23a', 'a9f8fbb0-073d-499f-8321-13c395e97aa6', 'f01e6ec6-cd08-4d8a-9804-13c24993be92'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:29:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bf609401-f52c-4771-b379-d53522ba4d2c tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bf609401-f52c-4771-b379-d53522ba4d2c tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bf609401-f52c-4771-b379-d53522ba4d2c tempest-ProjectMemberTests-945597890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-bf609401-f52c-4771-b379-d53522ba4d2c tempest-ProjectMemberTests-945597890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-bf609401-f52c-4771-b379-d53522ba4d2c tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bf609401-f52c-4771-b379-d53522ba4d2c tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:59 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:29:59 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:59 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-bf609401-f52c-4771-b379-d53522ba4d2c tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.699s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:59 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-bf609401-f52c-4771-b379-d53522ba4d2c tempest-ProjectMemberTests-945597890 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:29:59 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-bf609401-f52c-4771-b379-d53522ba4d2c tempest-ProjectMemberTests-945597890 None] Deleted volume successfully. Jul 08 01:29:59 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-bf609401-f52c-4771-b379-d53522ba4d2c tempest-ProjectMemberTests-945597890 None] Lock "cinder-747f09d5-26a0-4e5a-ab91-95d88ce321d3-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:00 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:30:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Flow 'volume_create_manager' (a0d58131-be85-4f99-bbb8-20d3c37d46a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:30:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bcd65b4-af74-49a7-b243-255a3c0b7ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bcd65b4-af74-49a7-b243-255a3c0b7ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-175253975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3968781f-1e71-4136-bed9-ef8d0e64b45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043a2938932846aa9a07c898bce15405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:30:00Z,use_quota=True,user_id='a3976431e3344a96ad536addcf6110bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc90ca73-c992-49c0-b7a6-e9d6bf73c299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc90ca73-c992-49c0-b7a6-e9d6bf73c299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e0aaf4-dcdf-4c42-b4dd-12372c22ba16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e0aaf4-dcdf-4c42-b4dd-12372c22ba16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3968781f-1e71-4136-bed9-ef8d0e64b45f', 'volume_name': 'volume-3968781f-1e71-4136-bed9-ef8d0e64b45f', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7443ccc9-093a-4b77-b576-8cfc13800343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7443ccc9-093a-4b77-b576-8cfc13800343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:00 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd7541ca-03ee-453c-bc65-87ddb25304df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:00 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Volume 3968781f-1e71-4136-bed9-ef8d0e64b45f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3968781f-1e71-4136-bed9-ef8d0e64b45f', 'volume_size': 1} Jul 08 01:30:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:00 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-175253975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3968781f-1e71-4136-bed9-ef8d0e64b45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043a2938932846aa9a07c898bce15405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:30:00Z,use_quota=True,user_id='a3976431e3344a96ad536addcf6110bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:30:00 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Creating volume 3968781f-1e71-4136-bed9-ef8d0e64b45f {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:30:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:00 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:30:00 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:30:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:00 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:30:00 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:30:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:00 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f 1073741824 Jul 08 01:30:00 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:01 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f 1073741824" returned: 0 in 0.940s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:01 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f Jul 08 01:30:01 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:02 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f" returned: 0 in 0.673s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:02 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:30:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd7541ca-03ee-453c-bc65-87ddb25304df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3968781f-1e71-4136-bed9-ef8d0e64b45f', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02fad5d-639f-4214-a98c-49a9c3cb5444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:02 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Volume volume-3968781f-1e71-4136-bed9-ef8d0e64b45f (3968781f-1e71-4136-bed9-ef8d0e64b45f): created successfully Jul 08 01:30:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02fad5d-639f-4214-a98c-49a9c3cb5444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:02 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Flow 'volume_create_manager' (a0d58131-be85-4f99-bbb8-20d3c37d46a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:30:02 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-c5b8310d-60a3-4a5d-86f1-3faf38a2b68e tempest-ProjectMemberTests-945597890 None] Created volume successfully. Jul 08 01:30:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9ec337c6-2888-4f76-8451-dc4db8bfefaa tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9ec337c6-2888-4f76-8451-dc4db8bfefaa tempest-ProjectMemberTests-945597890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:03 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-9ec337c6-2888-4f76-8451-dc4db8bfefaa tempest-ProjectMemberTests-945597890 None] Creating offline snapshot e567ae1f-a881-42b1-aa75-d714e9c42843 of volume 3968781f-1e71-4136-bed9-ef8d0e64b45f {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:30:03 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2e63ba-eb1d-409f-be1c-77dcff1aa1ae]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9ec337c6-2888-4f76-8451-dc4db8bfefaa tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:03 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f Jul 08 01:30:03 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:04 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9ec337c6-2888-4f76-8451-dc4db8bfefaa tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f" returned: 0 in 0.846s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9ec337c6-2888-4f76-8451-dc4db8bfefaa tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f.e567ae1f-a881-42b1-aa75-d714e9c42843 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:04 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f.e567ae1f-a881-42b1-aa75-d714e9c42843 1G Jul 08 01:30:04 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:05 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9ec337c6-2888-4f76-8451-dc4db8bfefaa tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f.e567ae1f-a881-42b1-aa75-d714e9c42843 1G" returned: 0 in 0.890s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9ec337c6-2888-4f76-8451-dc4db8bfefaa tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3968781f-1e71-4136-bed9-ef8d0e64b45f -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f.e567ae1f-a881-42b1-aa75-d714e9c42843 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:05 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3968781f-1e71-4136-bed9-ef8d0e64b45f -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f.e567ae1f-a881-42b1-aa75-d714e9c42843 Jul 08 01:30:05 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:06 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9ec337c6-2888-4f76-8451-dc4db8bfefaa tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3968781f-1e71-4136-bed9-ef8d0e64b45f -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f.e567ae1f-a881-42b1-aa75-d714e9c42843" returned: 0 in 0.757s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:06 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-9ec337c6-2888-4f76-8451-dc4db8bfefaa tempest-ProjectMemberTests-945597890 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f.e567ae1f-a881-42b1-aa75-d714e9c42843 is being set with open permissions: ugo+rw Jul 08 01:30:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9ec337c6-2888-4f76-8451-dc4db8bfefaa tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f.e567ae1f-a881-42b1-aa75-d714e9c42843 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:06 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f.e567ae1f-a881-42b1-aa75-d714e9c42843 Jul 08 01:30:06 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:06 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9ec337c6-2888-4f76-8451-dc4db8bfefaa tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f.e567ae1f-a881-42b1-aa75-d714e9c42843" returned: 0 in 0.695s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:06 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=97,cinder:INSERT=38,cinder:UPDATE=146,cinder:DELETE=14 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:30:06 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=123,cinder:DELETE=9,cinder:UPDATE=131,cinder:INSERT=46 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:30:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9ec337c6-2888-4f76-8451-dc4db8bfefaa tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:06 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f.info Jul 08 01:30:06 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:07 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9ec337c6-2888-4f76-8451-dc4db8bfefaa tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f.info" returned: 0 in 0.714s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:07 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-9ec337c6-2888-4f76-8451-dc4db8bfefaa tempest-ProjectMemberTests-945597890 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f.info is being set with open permissions: ugo+rw Jul 08 01:30:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9ec337c6-2888-4f76-8451-dc4db8bfefaa tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:07 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f.info Jul 08 01:30:07 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:08 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9ec337c6-2888-4f76-8451-dc4db8bfefaa tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f.info" returned: 0 in 0.675s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9ec337c6-2888-4f76-8451-dc4db8bfefaa tempest-ProjectMemberTests-945597890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.680s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:08 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-9ec337c6-2888-4f76-8451-dc4db8bfefaa tempest-ProjectMemberTests-945597890 None] Create snapshot completed successfully Jul 08 01:30:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a5a9add3-684b-468b-bb52-5a6db607f517 tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-e567ae1f-a881-42b1-aa75-d714e9c42843-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a5a9add3-684b-468b-bb52-5a6db607f517 tempest-ProjectMemberTests-945597890 None] Lock "cinder-e567ae1f-a881-42b1-aa75-d714e9c42843-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a5a9add3-684b-468b-bb52-5a6db607f517 tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-quobyte-3968781f-1e71-4136-bed9-ef8d0e64b45f" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a5a9add3-684b-468b-bb52-5a6db607f517 tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-3968781f-1e71-4136-bed9-ef8d0e64b45f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a5a9add3-684b-468b-bb52-5a6db607f517 tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-quobyte-e567ae1f-a881-42b1-aa75-d714e9c42843" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:08 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a5a9add3-684b-468b-bb52-5a6db607f517 tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-e567ae1f-a881-42b1-aa75-d714e9c42843" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:08 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-a5a9add3-684b-468b-bb52-5a6db607f517 tempest-ProjectMemberTests-945597890 None] Deleting offline snapshot e567ae1f-a881-42b1-aa75-d714e9c42843 of volume 3968781f-1e71-4136-bed9-ef8d0e64b45f {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:30:08 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-a5a9add3-684b-468b-bb52-5a6db607f517 tempest-ProjectMemberTests-945597890 None] snapshot_file for this snap is: volume-3968781f-1e71-4136-bed9-ef8d0e64b45f.e567ae1f-a881-42b1-aa75-d714e9c42843 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:30:08 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[068292c8-b1ea-44a4-a694-d8b0083d89c2]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a5a9add3-684b-468b-bb52-5a6db607f517 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f.e567ae1f-a881-42b1-aa75-d714e9c42843 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:09 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f.e567ae1f-a881-42b1-aa75-d714e9c42843 Jul 08 01:30:09 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:09 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a5a9add3-684b-468b-bb52-5a6db607f517 tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f.e567ae1f-a881-42b1-aa75-d714e9c42843" returned: 0 in 0.900s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-a5a9add3-684b-468b-bb52-5a6db607f517 tempest-ProjectMemberTests-945597890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3968781f-1e71-4136-bed9-ef8d0e64b45f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:30:09 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbab3a32-5353-4868-8e12-2e2116dc6690]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a5a9add3-684b-468b-bb52-5a6db607f517 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:10 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f Jul 08 01:30:10 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:10 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a5a9add3-684b-468b-bb52-5a6db607f517 tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f" returned: 0 in 0.923s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a5a9add3-684b-468b-bb52-5a6db607f517 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f.e567ae1f-a881-42b1-aa75-d714e9c42843 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:10 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f.e567ae1f-a881-42b1-aa75-d714e9c42843 Jul 08 01:30:10 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:11 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a5a9add3-684b-468b-bb52-5a6db607f517 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f.e567ae1f-a881-42b1-aa75-d714e9c42843" returned: 0 in 0.801s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a5a9add3-684b-468b-bb52-5a6db607f517 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f.e567ae1f-a881-42b1-aa75-d714e9c42843 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:11 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f.e567ae1f-a881-42b1-aa75-d714e9c42843 Jul 08 01:30:11 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:12 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:12 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a5a9add3-684b-468b-bb52-5a6db607f517 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f.e567ae1f-a881-42b1-aa75-d714e9c42843" returned: 0 in 0.841s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:12 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a5a9add3-684b-468b-bb52-5a6db607f517 tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-e567ae1f-a881-42b1-aa75-d714e9c42843" released by "_delete_snapshot" :: held 3.591s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:12 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a5a9add3-684b-468b-bb52-5a6db607f517 tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-3968781f-1e71-4136-bed9-ef8d0e64b45f" released by "delete_snapshot" :: held 3.627s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:12 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-a5a9add3-684b-468b-bb52-5a6db607f517 tempest-ProjectMemberTests-945597890 None] Created reservations ['5e0498c7-ea68-4ccf-8e16-fb926dd91c30', 'd6b44f56-86cb-47c5-b632-1443c1728a42', '30b7b5ec-1295-4dcc-b0c5-a002caaabc01', '80d495bb-4011-4135-8de0-a0b79b1311f8'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:30:12 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-a5a9add3-684b-468b-bb52-5a6db607f517 tempest-ProjectMemberTests-945597890 None] Delete snapshot completed successfully. Jul 08 01:30:12 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-a5a9add3-684b-468b-bb52-5a6db607f517 tempest-ProjectMemberTests-945597890 None] Lock "cinder-e567ae1f-a881-42b1-aa75-d714e9c42843-delete_snapshot" released by "delete_snapshot" :: held 3.830s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:13 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-db9c3580-023a-4c80-8148-706d64c085e1 tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-3968781f-1e71-4136-bed9-ef8d0e64b45f-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:13 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-db9c3580-023a-4c80-8148-706d64c085e1 tempest-ProjectMemberTests-945597890 None] Lock "cinder-3968781f-1e71-4136-bed9-ef8d0e64b45f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:13 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-db9c3580-023a-4c80-8148-706d64c085e1 tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-quobyte-3968781f-1e71-4136-bed9-ef8d0e64b45f" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:13 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-db9c3580-023a-4c80-8148-706d64c085e1 tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-3968781f-1e71-4136-bed9-ef8d0e64b45f" acquired by "delete_volume" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:13 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00f0728-01fa-43c4-b89d-c5bc9853c6ca]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-db9c3580-023a-4c80-8148-706d64c085e1 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:13 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f Jul 08 01:30:13 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:13 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:30:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Flow 'volume_create_manager' (e1b02be6-eee5-4c99-bc3c-524101f01811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:30:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e48ae8b-213d-4761-b5dc-b87910701952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e48ae8b-213d-4761-b5dc-b87910701952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-474449760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5730717-d14e-458d-ada8-4013eaeef41f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a62da4dd8e46938522f825e10d0288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:30:13Z,use_quota=True,user_id='ea393b42482c4e119536639aac7666e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd39638-0a3a-465b-8357-85e2ce8e1ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd39638-0a3a-465b-8357-85e2ce8e1ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6644ae63-2c3e-40fc-9979-44a4789362de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6644ae63-2c3e-40fc-9979-44a4789362de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5730717-d14e-458d-ada8-4013eaeef41f', 'volume_name': 'volume-b5730717-d14e-458d-ada8-4013eaeef41f', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e548dafb-a3ac-4461-970c-fc16dedd988d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e548dafb-a3ac-4461-970c-fc16dedd988d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:13 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee090105-ca61-4333-8e76-53c5ceb57394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:13 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Volume b5730717-d14e-458d-ada8-4013eaeef41f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5730717-d14e-458d-ada8-4013eaeef41f', 'volume_size': 1} Jul 08 01:30:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-474449760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5730717-d14e-458d-ada8-4013eaeef41f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a62da4dd8e46938522f825e10d0288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:30:13Z,use_quota=True,user_id='ea393b42482c4e119536639aac7666e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:30:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Creating volume b5730717-d14e-458d-ada8-4013eaeef41f {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:30:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:30:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:30:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:13 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:30:13 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:30:13 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b5730717-d14e-458d-ada8-4013eaeef41f 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:13 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b5730717-d14e-458d-ada8-4013eaeef41f 1073741824 Jul 08 01:30:13 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:14 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-db9c3580-023a-4c80-8148-706d64c085e1 tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f" returned: 0 in 0.870s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-db9c3580-023a-4c80-8148-706d64c085e1 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:14 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f Jul 08 01:30:14 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:14 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b5730717-d14e-458d-ada8-4013eaeef41f 1073741824" returned: 0 in 1.064s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:14 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b5730717-d14e-458d-ada8-4013eaeef41f {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:14 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b5730717-d14e-458d-ada8-4013eaeef41f Jul 08 01:30:14 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:14 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-db9c3580-023a-4c80-8148-706d64c085e1 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-3968781f-1e71-4136-bed9-ef8d0e64b45f" returned: 0 in 0.771s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:15 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-db9c3580-023a-4c80-8148-706d64c085e1 tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-3968781f-1e71-4136-bed9-ef8d0e64b45f" released by "delete_volume" :: held 1.741s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:15 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-db9c3580-023a-4c80-8148-706d64c085e1 tempest-ProjectMemberTests-945597890 None] Created reservations ['ac8a228f-2277-4019-9556-0ba7a64ca43c', '7ddd2780-1290-4196-9813-3ad0cbf60300', '5629a2cd-9e75-4822-a0a7-71c43bc9f2bd', 'df01377f-8370-4d36-892c-d60fec7b2acb'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:30:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-db9c3580-023a-4c80-8148-706d64c085e1 tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-db9c3580-023a-4c80-8148-706d64c085e1 tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:15 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-db9c3580-023a-4c80-8148-706d64c085e1 tempest-ProjectMemberTests-945597890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:30:15 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-db9c3580-023a-4c80-8148-706d64c085e1 tempest-ProjectMemberTests-945597890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:30:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-db9c3580-023a-4c80-8148-706d64c085e1 tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-db9c3580-023a-4c80-8148-706d64c085e1 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:15 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:30:15 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:15 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b5730717-d14e-458d-ada8-4013eaeef41f" returned: 0 in 0.725s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:15 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] <== create_volume: return (1843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:30:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee090105-ca61-4333-8e76-53c5ceb57394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5730717-d14e-458d-ada8-4013eaeef41f', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4bd7e1-8954-410e-9cd1-f39002ca2629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:15 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Volume volume-b5730717-d14e-458d-ada8-4013eaeef41f (b5730717-d14e-458d-ada8-4013eaeef41f): created successfully Jul 08 01:30:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4bd7e1-8954-410e-9cd1-f39002ca2629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Flow 'volume_create_manager' (e1b02be6-eee5-4c99-bc3c-524101f01811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:30:15 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-805498eb-7ef5-4e3e-bcf4-c0bf1d895c1d tempest-ProjectReaderTests-694192501 None] Created volume successfully. Jul 08 01:30:15 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-db9c3580-023a-4c80-8148-706d64c085e1 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.769s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:15 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-db9c3580-023a-4c80-8148-706d64c085e1 tempest-ProjectMemberTests-945597890 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:30:15 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-db9c3580-023a-4c80-8148-706d64c085e1 tempest-ProjectMemberTests-945597890 None] Deleted volume successfully. Jul 08 01:30:15 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:30:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Flow 'volume_create_manager' (b06641ce-e662-4b18-aa5c-dfb07c779edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:30:15 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f13498-f240-4b1e-97ca-b851821959f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f13498-f240-4b1e-97ca-b851821959f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1808576018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4fccf89-510e-4ec1-9b86-7b7a21399a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043a2938932846aa9a07c898bce15405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:30:16Z,use_quota=True,user_id='a3976431e3344a96ad536addcf6110bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d689597a-94aa-4997-9ab0-524a005dc856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d689597a-94aa-4997-9ab0-524a005dc856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b05ee592-0d9d-41c3-8b51-06bc456c7d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b05ee592-0d9d-41c3-8b51-06bc456c7d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4fccf89-510e-4ec1-9b86-7b7a21399a27', 'volume_name': 'volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c366935d-ed4d-4383-8ce2-8bf95d1dc333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c366935d-ed4d-4383-8ce2-8bf95d1dc333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:16 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17420278-3554-444e-bc56-1ad96e553827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:16 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Volume a4fccf89-510e-4ec1-9b86-7b7a21399a27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27', 'volume_size': 1} Jul 08 01:30:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1808576018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4fccf89-510e-4ec1-9b86-7b7a21399a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043a2938932846aa9a07c898bce15405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:30:16Z,use_quota=True,user_id='a3976431e3344a96ad536addcf6110bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:30:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Creating volume a4fccf89-510e-4ec1-9b86-7b7a21399a27 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:30:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:30:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:30:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:16 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:30:16 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:30:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-db9c3580-023a-4c80-8148-706d64c085e1 tempest-ProjectMemberTests-945597890 None] Lock "cinder-3968781f-1e71-4136-bed9-ef8d0e64b45f-delete_volume" released by "delete_volume" :: held 2.892s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:16 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27 1073741824 Jul 08 01:30:16 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-9c3781fe-6e1d-4488-8545-5f0afeba7dd5 tempest-ProjectReaderTests-694192501 None] Acquiring lock "cinder-b5730717-d14e-458d-ada8-4013eaeef41f-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:16 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-9c3781fe-6e1d-4488-8545-5f0afeba7dd5 tempest-ProjectReaderTests-694192501 None] Lock "cinder-b5730717-d14e-458d-ada8-4013eaeef41f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:17 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-9c3781fe-6e1d-4488-8545-5f0afeba7dd5 tempest-ProjectReaderTests-694192501 None] Acquiring lock "cinder-quobyte-b5730717-d14e-458d-ada8-4013eaeef41f" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:17 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-9c3781fe-6e1d-4488-8545-5f0afeba7dd5 tempest-ProjectReaderTests-694192501 None] Lock "cinder-quobyte-b5730717-d14e-458d-ada8-4013eaeef41f" acquired by "delete_volume" :: waited 0.021s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:17 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8705ac-8c41-43e2-bde7-479b9c086ec0]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9c3781fe-6e1d-4488-8545-5f0afeba7dd5 tempest-ProjectReaderTests-694192501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b5730717-d14e-458d-ada8-4013eaeef41f {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:17 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27 1073741824" returned: 0 in 1.037s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:17 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27 Jul 08 01:30:17 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:17 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b5730717-d14e-458d-ada8-4013eaeef41f Jul 08 01:30:17 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:17 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27" returned: 0 in 0.768s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:17 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:30:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.864s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:18 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9c3781fe-6e1d-4488-8545-5f0afeba7dd5 tempest-ProjectReaderTests-694192501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b5730717-d14e-458d-ada8-4013eaeef41f" returned: 0 in 0.984s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9c3781fe-6e1d-4488-8545-5f0afeba7dd5 tempest-ProjectReaderTests-694192501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b5730717-d14e-458d-ada8-4013eaeef41f {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:18 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b5730717-d14e-458d-ada8-4013eaeef41f Jul 08 01:30:18 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17420278-3554-444e-bc56-1ad96e553827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d18af3-b488-41a6-b0fa-650593a333db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:18 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Volume volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27 (a4fccf89-510e-4ec1-9b86-7b7a21399a27): created successfully Jul 08 01:30:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d18af3-b488-41a6-b0fa-650593a333db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Flow 'volume_create_manager' (b06641ce-e662-4b18-aa5c-dfb07c779edb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:30:18 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9c3781fe-6e1d-4488-8545-5f0afeba7dd5 tempest-ProjectReaderTests-694192501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-b5730717-d14e-458d-ada8-4013eaeef41f" returned: 0 in 0.672s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-9c3781fe-6e1d-4488-8545-5f0afeba7dd5 tempest-ProjectReaderTests-694192501 None] Lock "cinder-quobyte-b5730717-d14e-458d-ada8-4013eaeef41f" released by "delete_volume" :: held 1.722s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:19 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-67481fd4-0b32-41e7-ade4-c12e40a0e391 tempest-ProjectMemberTests-945597890 None] Created volume successfully. Jul 08 01:30:20 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-9c3781fe-6e1d-4488-8545-5f0afeba7dd5 tempest-ProjectReaderTests-694192501 None] Created reservations ['a766c389-a167-4b3c-8bb0-f5ac3643ce18', '2fc8be39-405e-48d2-b9fc-23c3c0312903', '78ab2409-bc73-4868-be6f-fcd962bc44c6', '8c141367-c16e-4ca9-80dc-4174da1c162e'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:30:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9c3781fe-6e1d-4488-8545-5f0afeba7dd5 tempest-ProjectReaderTests-694192501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9c3781fe-6e1d-4488-8545-5f0afeba7dd5 tempest-ProjectReaderTests-694192501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-9c3781fe-6e1d-4488-8545-5f0afeba7dd5 tempest-ProjectReaderTests-694192501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:30:23 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-9c3781fe-6e1d-4488-8545-5f0afeba7dd5 tempest-ProjectReaderTests-694192501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:30:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-9c3781fe-6e1d-4488-8545-5f0afeba7dd5 tempest-ProjectReaderTests-694192501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9c3781fe-6e1d-4488-8545-5f0afeba7dd5 tempest-ProjectReaderTests-694192501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:23 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:30:23 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-01195829-d68f-4177-a1c9-0b9c16653684 tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-01195829-d68f-4177-a1c9-0b9c16653684 tempest-ProjectMemberTests-945597890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-01195829-d68f-4177-a1c9-0b9c16653684 tempest-ProjectMemberTests-945597890 None] Creating offline snapshot fabb3b75-027a-4ac5-8ba4-a521a35f10ac of volume a4fccf89-510e-4ec1-9b86-7b7a21399a27 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:30:24 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab83ecfe-676f-44fb-84d0-b374e7818d67]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-01195829-d68f-4177-a1c9-0b9c16653684 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:24 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27 Jul 08 01:30:24 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:24 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-9c3781fe-6e1d-4488-8545-5f0afeba7dd5 tempest-ProjectReaderTests-694192501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.697s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:24 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-9c3781fe-6e1d-4488-8545-5f0afeba7dd5 tempest-ProjectReaderTests-694192501 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:30:24 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-9c3781fe-6e1d-4488-8545-5f0afeba7dd5 tempest-ProjectReaderTests-694192501 None] Deleted volume successfully. Jul 08 01:30:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-9c3781fe-6e1d-4488-8545-5f0afeba7dd5 tempest-ProjectReaderTests-694192501 None] Lock "cinder-b5730717-d14e-458d-ada8-4013eaeef41f-delete_volume" released by "delete_volume" :: held 7.457s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:24 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:30:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Flow 'volume_create_manager' (5427304e-2092-4b80-8f85-897070dbd523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:30:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222fde0c-2b35-49ad-8dc0-260e1065f5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222fde0c-2b35-49ad-8dc0-260e1065f5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1473847781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a6b773-0c80-47a4-af6a-1528554347ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a62da4dd8e46938522f825e10d0288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:30:24Z,use_quota=True,user_id='ea393b42482c4e119536639aac7666e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5d5d452-94f7-438d-a689-6ca36ca80aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5d5d452-94f7-438d-a689-6ca36ca80aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5e207e-eaaf-425f-be5a-55ccff19c1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5e207e-eaaf-425f-be5a-55ccff19c1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7a6b773-0c80-47a4-af6a-1528554347ae', 'volume_name': 'volume-d7a6b773-0c80-47a4-af6a-1528554347ae', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47019d25-8985-4281-9d6b-082e77e7d762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47019d25-8985-4281-9d6b-082e77e7d762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:24 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c86199f-fcc6-4982-9968-e8f287aa31ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:24 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Volume d7a6b773-0c80-47a4-af6a-1528554347ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7a6b773-0c80-47a4-af6a-1528554347ae', 'volume_size': 1} Jul 08 01:30:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:24 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-01195829-d68f-4177-a1c9-0b9c16653684 tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27" returned: 0 in 0.807s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-01195829-d68f-4177-a1c9-0b9c16653684 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27.fabb3b75-027a-4ac5-8ba4-a521a35f10ac 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:24 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27.fabb3b75-027a-4ac5-8ba4-a521a35f10ac 1G Jul 08 01:30:24 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:25 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-01195829-d68f-4177-a1c9-0b9c16653684 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27.fabb3b75-027a-4ac5-8ba4-a521a35f10ac 1G" returned: 0 in 0.804s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-01195829-d68f-4177-a1c9-0b9c16653684 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27.fabb3b75-027a-4ac5-8ba4-a521a35f10ac {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:25 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27.fabb3b75-027a-4ac5-8ba4-a521a35f10ac Jul 08 01:30:25 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:26 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-01195829-d68f-4177-a1c9-0b9c16653684 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27.fabb3b75-027a-4ac5-8ba4-a521a35f10ac" returned: 0 in 0.731s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:26 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-01195829-d68f-4177-a1c9-0b9c16653684 tempest-ProjectMemberTests-945597890 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27.fabb3b75-027a-4ac5-8ba4-a521a35f10ac is being set with open permissions: ugo+rw Jul 08 01:30:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-01195829-d68f-4177-a1c9-0b9c16653684 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27.fabb3b75-027a-4ac5-8ba4-a521a35f10ac {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:26 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27.fabb3b75-027a-4ac5-8ba4-a521a35f10ac Jul 08 01:30:26 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:27 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-01195829-d68f-4177-a1c9-0b9c16653684 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27.fabb3b75-027a-4ac5-8ba4-a521a35f10ac" returned: 0 in 0.691s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-01195829-d68f-4177-a1c9-0b9c16653684 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:27 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27.info Jul 08 01:30:27 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:27 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-01195829-d68f-4177-a1c9-0b9c16653684 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27.info" returned: 0 in 0.656s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:27 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-01195829-d68f-4177-a1c9-0b9c16653684 tempest-ProjectMemberTests-945597890 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27.info is being set with open permissions: ugo+rw Jul 08 01:30:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-01195829-d68f-4177-a1c9-0b9c16653684 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:27 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27.info Jul 08 01:30:27 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:28 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-01195829-d68f-4177-a1c9-0b9c16653684 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27.info" returned: 0 in 0.623s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-01195829-d68f-4177-a1c9-0b9c16653684 tempest-ProjectMemberTests-945597890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.436s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.980s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:28 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1473847781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a6b773-0c80-47a4-af6a-1528554347ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a62da4dd8e46938522f825e10d0288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:30:24Z,use_quota=True,user_id='ea393b42482c4e119536639aac7666e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:30:28 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Creating volume d7a6b773-0c80-47a4-af6a-1528554347ae {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:30:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:28 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:30:28 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:30:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:28 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:30:28 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:30:28 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d7a6b773-0c80-47a4-af6a-1528554347ae 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:28 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d7a6b773-0c80-47a4-af6a-1528554347ae 1073741824 Jul 08 01:30:28 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:28 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-01195829-d68f-4177-a1c9-0b9c16653684 tempest-ProjectMemberTests-945597890 None] Create snapshot completed successfully Jul 08 01:30:29 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d7a6b773-0c80-47a4-af6a-1528554347ae 1073741824" returned: 0 in 0.808s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d7a6b773-0c80-47a4-af6a-1528554347ae {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:29 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d7a6b773-0c80-47a4-af6a-1528554347ae Jul 08 01:30:29 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:29 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3c0a1fdc-314a-4e8c-b977-99f2c6e3c796 tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-fabb3b75-027a-4ac5-8ba4-a521a35f10ac-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:29 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3c0a1fdc-314a-4e8c-b977-99f2c6e3c796 tempest-ProjectMemberTests-945597890 None] Lock "cinder-fabb3b75-027a-4ac5-8ba4-a521a35f10ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:29 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3c0a1fdc-314a-4e8c-b977-99f2c6e3c796 tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-quobyte-a4fccf89-510e-4ec1-9b86-7b7a21399a27" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:29 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3c0a1fdc-314a-4e8c-b977-99f2c6e3c796 tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-a4fccf89-510e-4ec1-9b86-7b7a21399a27" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:29 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3c0a1fdc-314a-4e8c-b977-99f2c6e3c796 tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-quobyte-fabb3b75-027a-4ac5-8ba4-a521a35f10ac" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:29 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3c0a1fdc-314a-4e8c-b977-99f2c6e3c796 tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-fabb3b75-027a-4ac5-8ba4-a521a35f10ac" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-3c0a1fdc-314a-4e8c-b977-99f2c6e3c796 tempest-ProjectMemberTests-945597890 None] Deleting offline snapshot fabb3b75-027a-4ac5-8ba4-a521a35f10ac of volume a4fccf89-510e-4ec1-9b86-7b7a21399a27 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:30:29 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-3c0a1fdc-314a-4e8c-b977-99f2c6e3c796 tempest-ProjectMemberTests-945597890 None] snapshot_file for this snap is: volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27.fabb3b75-027a-4ac5-8ba4-a521a35f10ac {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:30:29 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4351474a-c586-4ad2-aea0-726134d66643]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:29 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3c0a1fdc-314a-4e8c-b977-99f2c6e3c796 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27.fabb3b75-027a-4ac5-8ba4-a521a35f10ac {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:29 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27.fabb3b75-027a-4ac5-8ba4-a521a35f10ac Jul 08 01:30:29 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:30 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d7a6b773-0c80-47a4-af6a-1528554347ae" returned: 0 in 0.665s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:30 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:30:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c86199f-fcc6-4982-9968-e8f287aa31ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7a6b773-0c80-47a4-af6a-1528554347ae', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (468c9781-7778-48f5-9e47-9b51a5e249a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:30 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Volume volume-d7a6b773-0c80-47a4-af6a-1528554347ae (d7a6b773-0c80-47a4-af6a-1528554347ae): created successfully Jul 08 01:30:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (468c9781-7778-48f5-9e47-9b51a5e249a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:30 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Flow 'volume_create_manager' (5427304e-2092-4b80-8f85-897070dbd523) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:30:30 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-955df973-f899-450b-b54d-52d3c931740b tempest-ProjectReaderTests-694192501 None] Created volume successfully. Jul 08 01:30:30 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3c0a1fdc-314a-4e8c-b977-99f2c6e3c796 tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27.fabb3b75-027a-4ac5-8ba4-a521a35f10ac" returned: 0 in 0.747s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:30 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-3c0a1fdc-314a-4e8c-b977-99f2c6e3c796 tempest-ProjectMemberTests-945597890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:30:30 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d555ee-0ae0-4e1d-85d0-2636c132e472]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3c0a1fdc-314a-4e8c-b977-99f2c6e3c796 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:30 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27 Jul 08 01:30:30 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:30 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ce706769-7e70-4bdb-becf-285e1f2d419d tempest-ProjectReaderTests-694192501 None] Acquiring lock "cinder-d7a6b773-0c80-47a4-af6a-1528554347ae-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:30 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ce706769-7e70-4bdb-becf-285e1f2d419d tempest-ProjectReaderTests-694192501 None] Lock "cinder-d7a6b773-0c80-47a4-af6a-1528554347ae-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:30 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ce706769-7e70-4bdb-becf-285e1f2d419d tempest-ProjectReaderTests-694192501 None] Acquiring lock "cinder-quobyte-d7a6b773-0c80-47a4-af6a-1528554347ae" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:30 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ce706769-7e70-4bdb-becf-285e1f2d419d tempest-ProjectReaderTests-694192501 None] Lock "cinder-quobyte-d7a6b773-0c80-47a4-af6a-1528554347ae" acquired by "delete_volume" :: waited 0.017s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:30 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f06b644-40fc-4b8a-85d8-4bc139c3ea8b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:30 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ce706769-7e70-4bdb-becf-285e1f2d419d tempest-ProjectReaderTests-694192501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d7a6b773-0c80-47a4-af6a-1528554347ae {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:31 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3c0a1fdc-314a-4e8c-b977-99f2c6e3c796 tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27" returned: 0 in 0.780s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3c0a1fdc-314a-4e8c-b977-99f2c6e3c796 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27.fabb3b75-027a-4ac5-8ba4-a521a35f10ac {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:31 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d7a6b773-0c80-47a4-af6a-1528554347ae Jul 08 01:30:31 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:31 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27.fabb3b75-027a-4ac5-8ba4-a521a35f10ac Jul 08 01:30:31 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:31 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ce706769-7e70-4bdb-becf-285e1f2d419d tempest-ProjectReaderTests-694192501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d7a6b773-0c80-47a4-af6a-1528554347ae" returned: 0 in 0.808s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ce706769-7e70-4bdb-becf-285e1f2d419d tempest-ProjectReaderTests-694192501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d7a6b773-0c80-47a4-af6a-1528554347ae {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:31 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d7a6b773-0c80-47a4-af6a-1528554347ae Jul 08 01:30:31 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:31 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3c0a1fdc-314a-4e8c-b977-99f2c6e3c796 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27.fabb3b75-027a-4ac5-8ba4-a521a35f10ac" returned: 0 in 0.780s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:31 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3c0a1fdc-314a-4e8c-b977-99f2c6e3c796 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27.fabb3b75-027a-4ac5-8ba4-a521a35f10ac {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:31 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27.fabb3b75-027a-4ac5-8ba4-a521a35f10ac Jul 08 01:30:31 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:32 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ce706769-7e70-4bdb-becf-285e1f2d419d tempest-ProjectReaderTests-694192501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-d7a6b773-0c80-47a4-af6a-1528554347ae" returned: 0 in 0.708s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:32 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ce706769-7e70-4bdb-becf-285e1f2d419d tempest-ProjectReaderTests-694192501 None] Lock "cinder-quobyte-d7a6b773-0c80-47a4-af6a-1528554347ae" released by "delete_volume" :: held 1.570s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:32 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-ce706769-7e70-4bdb-becf-285e1f2d419d tempest-ProjectReaderTests-694192501 None] Created reservations ['3c730556-0751-4555-b4f9-89f58842e592', 'efc7aa6a-9bf1-4000-aff0-491ed23ddb00', '142eb912-f420-4718-977b-8f8b32cccb56', '70cc7b07-2087-4197-a197-c807c7e8b0c0'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:30:32 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3c0a1fdc-314a-4e8c-b977-99f2c6e3c796 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27.fabb3b75-027a-4ac5-8ba4-a521a35f10ac" returned: 0 in 0.703s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:32 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3c0a1fdc-314a-4e8c-b977-99f2c6e3c796 tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-fabb3b75-027a-4ac5-8ba4-a521a35f10ac" released by "_delete_snapshot" :: held 3.123s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:32 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3c0a1fdc-314a-4e8c-b977-99f2c6e3c796 tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-a4fccf89-510e-4ec1-9b86-7b7a21399a27" released by "delete_snapshot" :: held 3.147s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ce706769-7e70-4bdb-becf-285e1f2d419d tempest-ProjectReaderTests-694192501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ce706769-7e70-4bdb-becf-285e1f2d419d tempest-ProjectReaderTests-694192501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:32 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ce706769-7e70-4bdb-becf-285e1f2d419d tempest-ProjectReaderTests-694192501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:30:32 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ce706769-7e70-4bdb-becf-285e1f2d419d tempest-ProjectReaderTests-694192501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:30:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ce706769-7e70-4bdb-becf-285e1f2d419d tempest-ProjectReaderTests-694192501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ce706769-7e70-4bdb-becf-285e1f2d419d tempest-ProjectReaderTests-694192501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:32 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:30:32 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:32 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-3c0a1fdc-314a-4e8c-b977-99f2c6e3c796 tempest-ProjectMemberTests-945597890 None] Created reservations ['700bc61f-30b3-4c21-a30d-f30e6fbd5025', '4c19acb5-5d47-4cdf-9c96-58213fd2a574', 'dec0ed9e-3a02-4252-98af-b1288ea4cdad', '896b6f99-852b-40fa-a49d-5acff6c0c062'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:30:32 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-3c0a1fdc-314a-4e8c-b977-99f2c6e3c796 tempest-ProjectMemberTests-945597890 None] Delete snapshot completed successfully. Jul 08 01:30:32 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3c0a1fdc-314a-4e8c-b977-99f2c6e3c796 tempest-ProjectMemberTests-945597890 None] Lock "cinder-fabb3b75-027a-4ac5-8ba4-a521a35f10ac-delete_snapshot" released by "delete_snapshot" :: held 3.339s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:33 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ce706769-7e70-4bdb-becf-285e1f2d419d tempest-ProjectReaderTests-694192501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.725s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:33 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-ce706769-7e70-4bdb-becf-285e1f2d419d tempest-ProjectReaderTests-694192501 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:30:33 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-ce706769-7e70-4bdb-becf-285e1f2d419d tempest-ProjectReaderTests-694192501 None] Deleted volume successfully. Jul 08 01:30:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ce706769-7e70-4bdb-becf-285e1f2d419d tempest-ProjectReaderTests-694192501 None] Lock "cinder-d7a6b773-0c80-47a4-af6a-1528554347ae-delete_volume" released by "delete_volume" :: held 2.567s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ff6ad350-615d-414c-ad78-581e0b3f451d tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-a4fccf89-510e-4ec1-9b86-7b7a21399a27-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ff6ad350-615d-414c-ad78-581e0b3f451d tempest-ProjectMemberTests-945597890 None] Lock "cinder-a4fccf89-510e-4ec1-9b86-7b7a21399a27-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ff6ad350-615d-414c-ad78-581e0b3f451d tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-quobyte-a4fccf89-510e-4ec1-9b86-7b7a21399a27" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:33 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ff6ad350-615d-414c-ad78-581e0b3f451d tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-a4fccf89-510e-4ec1-9b86-7b7a21399a27" acquired by "delete_volume" :: waited 0.015s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:33 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab230c0-9368-4d56-9313-0bb25608c6f6]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:33 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ff6ad350-615d-414c-ad78-581e0b3f451d tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:33 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27 Jul 08 01:30:33 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:34 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ff6ad350-615d-414c-ad78-581e0b3f451d tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27" returned: 0 in 0.858s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:34 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ff6ad350-615d-414c-ad78-581e0b3f451d tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:34 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27 Jul 08 01:30:34 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:35 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ff6ad350-615d-414c-ad78-581e0b3f451d tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-a4fccf89-510e-4ec1-9b86-7b7a21399a27" returned: 0 in 0.687s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:35 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ff6ad350-615d-414c-ad78-581e0b3f451d tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-a4fccf89-510e-4ec1-9b86-7b7a21399a27" released by "delete_volume" :: held 1.615s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:35 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-ff6ad350-615d-414c-ad78-581e0b3f451d tempest-ProjectMemberTests-945597890 None] Created reservations ['63327548-ff14-49d1-ac5b-f4dd7911cbe8', '54bf823a-e383-482f-9426-1c7ebdc0a552', '62acf1e0-6e63-404c-850b-e7414fddba70', '1aa0b6d0-4f0c-4574-a8f6-68bed241ec9b'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:30:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ff6ad350-615d-414c-ad78-581e0b3f451d tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ff6ad350-615d-414c-ad78-581e0b3f451d tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:35 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ff6ad350-615d-414c-ad78-581e0b3f451d tempest-ProjectMemberTests-945597890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:30:35 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ff6ad350-615d-414c-ad78-581e0b3f451d tempest-ProjectMemberTests-945597890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:30:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ff6ad350-615d-414c-ad78-581e0b3f451d tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:35 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ff6ad350-615d-414c-ad78-581e0b3f451d tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:35 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:30:35 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:36 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ff6ad350-615d-414c-ad78-581e0b3f451d tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.698s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:36 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-ff6ad350-615d-414c-ad78-581e0b3f451d tempest-ProjectMemberTests-945597890 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:30:36 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-ff6ad350-615d-414c-ad78-581e0b3f451d tempest-ProjectMemberTests-945597890 None] Deleted volume successfully. Jul 08 01:30:36 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ff6ad350-615d-414c-ad78-581e0b3f451d tempest-ProjectMemberTests-945597890 None] Lock "cinder-a4fccf89-510e-4ec1-9b86-7b7a21399a27-delete_volume" released by "delete_volume" :: held 2.559s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:36 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:30:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Flow 'volume_create_manager' (3e491af1-38c3-47ec-a4fe-e62a5c70873a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:30:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555341b1-a2d6-43b3-a79a-4a0976ab3fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555341b1-a2d6-43b3-a79a-4a0976ab3fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1461812908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf4dee5-809d-40b8-84b3-cd901e705291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043a2938932846aa9a07c898bce15405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:30:36Z,use_quota=True,user_id='a3976431e3344a96ad536addcf6110bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eda5b77-5db4-461a-bf74-18fdc6286f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eda5b77-5db4-461a-bf74-18fdc6286f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9308332-4f7a-44d8-a578-3fa66505b80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9308332-4f7a-44d8-a578-3fa66505b80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bf4dee5-809d-40b8-84b3-cd901e705291', 'volume_name': 'volume-0bf4dee5-809d-40b8-84b3-cd901e705291', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99f2617-a8e7-475d-a49a-903fdadd6b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99f2617-a8e7-475d-a49a-903fdadd6b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:36 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df0ff14-841a-41e6-a00f-5c01105cfbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:36 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Volume 0bf4dee5-809d-40b8-84b3-cd901e705291: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bf4dee5-809d-40b8-84b3-cd901e705291', 'volume_size': 1} Jul 08 01:30:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1461812908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf4dee5-809d-40b8-84b3-cd901e705291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043a2938932846aa9a07c898bce15405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:30:36Z,use_quota=True,user_id='a3976431e3344a96ad536addcf6110bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:30:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Creating volume 0bf4dee5-809d-40b8-84b3-cd901e705291 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:30:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:30:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:30:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:36 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:30:36 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:30:36 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:36 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291 1073741824 Jul 08 01:30:36 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:37 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291 1073741824" returned: 0 in 0.910s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:37 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:37 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291 Jul 08 01:30:37 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:38 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291" returned: 0 in 0.644s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:30:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df0ff14-841a-41e6-a00f-5c01105cfbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bf4dee5-809d-40b8-84b3-cd901e705291', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec3489e-9ba8-425e-a3c6-6b11beec3191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:38 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Volume volume-0bf4dee5-809d-40b8-84b3-cd901e705291 (0bf4dee5-809d-40b8-84b3-cd901e705291): created successfully Jul 08 01:30:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec3489e-9ba8-425e-a3c6-6b11beec3191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:38 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Flow 'volume_create_manager' (3e491af1-38c3-47ec-a4fe-e62a5c70873a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:30:38 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-7c1cc0af-2e80-4ffe-b893-06b2f93db77d tempest-ProjectMemberTests-945597890 None] Created volume successfully. Jul 08 01:30:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-faa5fb03-5b5a-405d-9f03-597a400b5e30 tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-faa5fb03-5b5a-405d-9f03-597a400b5e30 tempest-ProjectMemberTests-945597890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:38 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-faa5fb03-5b5a-405d-9f03-597a400b5e30 tempest-ProjectMemberTests-945597890 None] Creating offline snapshot 9e9ad31b-7a4d-4ed4-8b13-a5615cbd665a of volume 0bf4dee5-809d-40b8-84b3-cd901e705291 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:30:38 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bfc587-6447-4db2-b1f6-b58d72be6bcc]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:38 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-faa5fb03-5b5a-405d-9f03-597a400b5e30 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:38 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291 Jul 08 01:30:38 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:39 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-faa5fb03-5b5a-405d-9f03-597a400b5e30 tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291" returned: 0 in 0.799s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:39 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-faa5fb03-5b5a-405d-9f03-597a400b5e30 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291.9e9ad31b-7a4d-4ed4-8b13-a5615cbd665a 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:39 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291.9e9ad31b-7a4d-4ed4-8b13-a5615cbd665a 1G Jul 08 01:30:39 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:40 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-faa5fb03-5b5a-405d-9f03-597a400b5e30 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291.9e9ad31b-7a4d-4ed4-8b13-a5615cbd665a 1G" returned: 0 in 0.854s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:40 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-faa5fb03-5b5a-405d-9f03-597a400b5e30 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bf4dee5-809d-40b8-84b3-cd901e705291 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291.9e9ad31b-7a4d-4ed4-8b13-a5615cbd665a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:40 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bf4dee5-809d-40b8-84b3-cd901e705291 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291.9e9ad31b-7a4d-4ed4-8b13-a5615cbd665a Jul 08 01:30:40 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:41 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-faa5fb03-5b5a-405d-9f03-597a400b5e30 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bf4dee5-809d-40b8-84b3-cd901e705291 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291.9e9ad31b-7a4d-4ed4-8b13-a5615cbd665a" returned: 0 in 0.749s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:41 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-faa5fb03-5b5a-405d-9f03-597a400b5e30 tempest-ProjectMemberTests-945597890 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291.9e9ad31b-7a4d-4ed4-8b13-a5615cbd665a is being set with open permissions: ugo+rw Jul 08 01:30:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-faa5fb03-5b5a-405d-9f03-597a400b5e30 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291.9e9ad31b-7a4d-4ed4-8b13-a5615cbd665a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:41 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291.9e9ad31b-7a4d-4ed4-8b13-a5615cbd665a Jul 08 01:30:41 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:41 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-faa5fb03-5b5a-405d-9f03-597a400b5e30 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291.9e9ad31b-7a4d-4ed4-8b13-a5615cbd665a" returned: 0 in 0.701s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:41 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-faa5fb03-5b5a-405d-9f03-597a400b5e30 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:41 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291.info Jul 08 01:30:41 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:42 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-faa5fb03-5b5a-405d-9f03-597a400b5e30 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291.info" returned: 0 in 0.683s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:42 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-faa5fb03-5b5a-405d-9f03-597a400b5e30 tempest-ProjectMemberTests-945597890 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291.info is being set with open permissions: ugo+rw Jul 08 01:30:42 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-faa5fb03-5b5a-405d-9f03-597a400b5e30 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:42 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291.info Jul 08 01:30:42 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:43 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-faa5fb03-5b5a-405d-9f03-597a400b5e30 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291.info" returned: 0 in 0.713s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:43 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-faa5fb03-5b5a-405d-9f03-597a400b5e30 tempest-ProjectMemberTests-945597890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.587s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:43 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-faa5fb03-5b5a-405d-9f03-597a400b5e30 tempest-ProjectMemberTests-945597890 None] Create snapshot completed successfully Jul 08 01:30:44 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3d78df73-9dd7-47e3-a0ae-15c465f51a3d tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-9e9ad31b-7a4d-4ed4-8b13-a5615cbd665a-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:44 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3d78df73-9dd7-47e3-a0ae-15c465f51a3d tempest-ProjectMemberTests-945597890 None] Lock "cinder-9e9ad31b-7a4d-4ed4-8b13-a5615cbd665a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:44 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3d78df73-9dd7-47e3-a0ae-15c465f51a3d tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-quobyte-0bf4dee5-809d-40b8-84b3-cd901e705291" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:44 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3d78df73-9dd7-47e3-a0ae-15c465f51a3d tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-0bf4dee5-809d-40b8-84b3-cd901e705291" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:44 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3d78df73-9dd7-47e3-a0ae-15c465f51a3d tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-quobyte-9e9ad31b-7a4d-4ed4-8b13-a5615cbd665a" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:44 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3d78df73-9dd7-47e3-a0ae-15c465f51a3d tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-9e9ad31b-7a4d-4ed4-8b13-a5615cbd665a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-3d78df73-9dd7-47e3-a0ae-15c465f51a3d tempest-ProjectMemberTests-945597890 None] Deleting offline snapshot 9e9ad31b-7a4d-4ed4-8b13-a5615cbd665a of volume 0bf4dee5-809d-40b8-84b3-cd901e705291 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:30:44 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-3d78df73-9dd7-47e3-a0ae-15c465f51a3d tempest-ProjectMemberTests-945597890 None] snapshot_file for this snap is: volume-0bf4dee5-809d-40b8-84b3-cd901e705291.9e9ad31b-7a4d-4ed4-8b13-a5615cbd665a {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:30:44 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[047c5402-8e41-411d-b101-d42458f7a14d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:44 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3d78df73-9dd7-47e3-a0ae-15c465f51a3d tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291.9e9ad31b-7a4d-4ed4-8b13-a5615cbd665a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:44 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291.9e9ad31b-7a4d-4ed4-8b13-a5615cbd665a Jul 08 01:30:44 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:45 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3d78df73-9dd7-47e3-a0ae-15c465f51a3d tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291.9e9ad31b-7a4d-4ed4-8b13-a5615cbd665a" returned: 0 in 0.867s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-3d78df73-9dd7-47e3-a0ae-15c465f51a3d tempest-ProjectMemberTests-945597890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bf4dee5-809d-40b8-84b3-cd901e705291(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:30:45 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfd3e35-0ac1-4c3b-b908-4b5545ee0a3a]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3d78df73-9dd7-47e3-a0ae-15c465f51a3d tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:45 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291 Jul 08 01:30:45 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:45 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:30:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:30:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:30:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:45 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:30:45 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:46 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3d78df73-9dd7-47e3-a0ae-15c465f51a3d tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291" returned: 0 in 0.970s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3d78df73-9dd7-47e3-a0ae-15c465f51a3d tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291.9e9ad31b-7a4d-4ed4-8b13-a5615cbd665a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:46 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291.9e9ad31b-7a4d-4ed4-8b13-a5615cbd665a Jul 08 01:30:46 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:46 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.763s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:46 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:30:46 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:30:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread count: 28 {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:30:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread info: [<_MainThread(MainThread, started 134382216167552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:30:46 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3d78df73-9dd7-47e3-a0ae-15c465f51a3d tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291.9e9ad31b-7a4d-4ed4-8b13-a5615cbd665a" returned: 0 in 0.833s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3d78df73-9dd7-47e3-a0ae-15c465f51a3d tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291.9e9ad31b-7a4d-4ed4-8b13-a5615cbd665a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:46 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291.9e9ad31b-7a4d-4ed4-8b13-a5615cbd665a Jul 08 01:30:46 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:47 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:47 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3d78df73-9dd7-47e3-a0ae-15c465f51a3d tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291.9e9ad31b-7a4d-4ed4-8b13-a5615cbd665a" returned: 0 in 0.669s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:47 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3d78df73-9dd7-47e3-a0ae-15c465f51a3d tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-9e9ad31b-7a4d-4ed4-8b13-a5615cbd665a" released by "_delete_snapshot" :: held 3.464s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:47 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3d78df73-9dd7-47e3-a0ae-15c465f51a3d tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-0bf4dee5-809d-40b8-84b3-cd901e705291" released by "delete_snapshot" :: held 3.496s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:47 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-3d78df73-9dd7-47e3-a0ae-15c465f51a3d tempest-ProjectMemberTests-945597890 None] Created reservations ['a6504cbe-5b88-4eb5-93e7-26b6d0d45e9e', '20043b4a-5c4d-496d-9790-0d68c3be9a33', '678fc4cd-749d-426a-ba39-cff700e7fb7e', 'b2807239-cf22-4af4-ab4d-8aeb64a91895'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:30:47 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-3d78df73-9dd7-47e3-a0ae-15c465f51a3d tempest-ProjectMemberTests-945597890 None] Delete snapshot completed successfully. Jul 08 01:30:47 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-3d78df73-9dd7-47e3-a0ae-15c465f51a3d tempest-ProjectMemberTests-945597890 None] Lock "cinder-9e9ad31b-7a4d-4ed4-8b13-a5615cbd665a-delete_snapshot" released by "delete_snapshot" :: held 3.668s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:48 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ae994503-439d-46bc-a530-a2ce83e131b9 tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-0bf4dee5-809d-40b8-84b3-cd901e705291-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:48 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ae994503-439d-46bc-a530-a2ce83e131b9 tempest-ProjectMemberTests-945597890 None] Lock "cinder-0bf4dee5-809d-40b8-84b3-cd901e705291-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:48 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ae994503-439d-46bc-a530-a2ce83e131b9 tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-quobyte-0bf4dee5-809d-40b8-84b3-cd901e705291" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:48 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ae994503-439d-46bc-a530-a2ce83e131b9 tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-0bf4dee5-809d-40b8-84b3-cd901e705291" acquired by "delete_volume" :: waited 0.023s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:48 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe80a644-713e-4cc1-a27f-8be1a1aa228a]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:48 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ae994503-439d-46bc-a530-a2ce83e131b9 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:48 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291 Jul 08 01:30:48 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:49 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ae994503-439d-46bc-a530-a2ce83e131b9 tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291" returned: 0 in 0.813s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ae994503-439d-46bc-a530-a2ce83e131b9 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:49 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291 Jul 08 01:30:49 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:49 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:49 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ae994503-439d-46bc-a530-a2ce83e131b9 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-0bf4dee5-809d-40b8-84b3-cd901e705291" returned: 0 in 0.689s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:49 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ae994503-439d-46bc-a530-a2ce83e131b9 tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-0bf4dee5-809d-40b8-84b3-cd901e705291" released by "delete_volume" :: held 1.579s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:50 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-ae994503-439d-46bc-a530-a2ce83e131b9 tempest-ProjectMemberTests-945597890 None] Created reservations ['19bc5c16-391c-4c6c-9794-2de890677924', '3fa5c812-5f77-4286-84ec-49514e7d14a1', 'd5c775c0-e277-4806-9d17-b5c4186b8d85', '7a1aaf74-6367-425c-83e3-e58fc366db51'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:30:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ae994503-439d-46bc-a530-a2ce83e131b9 tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ae994503-439d-46bc-a530-a2ce83e131b9 tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:50 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ae994503-439d-46bc-a530-a2ce83e131b9 tempest-ProjectMemberTests-945597890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:30:50 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ae994503-439d-46bc-a530-a2ce83e131b9 tempest-ProjectMemberTests-945597890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:30:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ae994503-439d-46bc-a530-a2ce83e131b9 tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ae994503-439d-46bc-a530-a2ce83e131b9 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:50 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:30:50 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:50 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:50 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ae994503-439d-46bc-a530-a2ce83e131b9 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.744s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:50 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-ae994503-439d-46bc-a530-a2ce83e131b9 tempest-ProjectMemberTests-945597890 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:30:50 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-ae994503-439d-46bc-a530-a2ce83e131b9 tempest-ProjectMemberTests-945597890 None] Deleted volume successfully. Jul 08 01:30:50 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ae994503-439d-46bc-a530-a2ce83e131b9 tempest-ProjectMemberTests-945597890 None] Lock "cinder-0bf4dee5-809d-40b8-84b3-cd901e705291-delete_volume" released by "delete_volume" :: held 2.560s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:30:51 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:30:51 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Flow 'volume_create_manager' (2942c372-024d-45c9-b08d-1f4d6557b6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:30:51 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367c50df-24d5-427f-9b62-44da267203f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:51 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367c50df-24d5-427f-9b62-44da267203f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1379310160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4868c65e-3dc8-4e27-ae8d-7c5349b52b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043a2938932846aa9a07c898bce15405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:30:51Z,use_quota=True,user_id='a3976431e3344a96ad536addcf6110bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:51 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fee2a14f-0ed2-4809-8246-305465f94f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:51 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fee2a14f-0ed2-4809-8246-305465f94f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:51 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3838e60-b8ae-4ec1-8966-b2ef59bc02d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:51 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3838e60-b8ae-4ec1-8966-b2ef59bc02d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4868c65e-3dc8-4e27-ae8d-7c5349b52b58', 'volume_name': 'volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:51 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948d3886-358c-4409-86c0-e36bcb19e59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:51 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948d3886-358c-4409-86c0-e36bcb19e59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:51 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e54049e0-84ea-4a43-aadc-77d98a2aa917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:51 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Volume 4868c65e-3dc8-4e27-ae8d-7c5349b52b58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58', 'volume_size': 1} Jul 08 01:30:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:51 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1379310160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4868c65e-3dc8-4e27-ae8d-7c5349b52b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043a2938932846aa9a07c898bce15405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:30:51Z,use_quota=True,user_id='a3976431e3344a96ad536addcf6110bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:30:51 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Creating volume 4868c65e-3dc8-4e27-ae8d-7c5349b52b58 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:30:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:51 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:30:51 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:30:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:51 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:30:51 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:30:51 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:51 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58 1073741824 Jul 08 01:30:51 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:52 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58 1073741824" returned: 0 in 0.955s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:52 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:52 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58 Jul 08 01:30:52 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:53 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58" returned: 0 in 0.718s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:53 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:30:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:53 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e54049e0-84ea-4a43-aadc-77d98a2aa917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:53 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d175730-6f6f-4366-ae66-63f69871c891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:30:53 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Volume volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58 (4868c65e-3dc8-4e27-ae8d-7c5349b52b58): created successfully Jul 08 01:30:53 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d175730-6f6f-4366-ae66-63f69871c891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:30:53 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Flow 'volume_create_manager' (2942c372-024d-45c9-b08d-1f4d6557b6fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:30:53 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-e292149f-359d-40fc-84b7-53c222c1ab4e tempest-ProjectMemberTests-945597890 None] Created volume successfully. Jul 08 01:30:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3ae1b62e-d365-4235-8370-931c7d15c8f3 tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:30:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3ae1b62e-d365-4235-8370-931c7d15c8f3 tempest-ProjectMemberTests-945597890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:30:53 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-3ae1b62e-d365-4235-8370-931c7d15c8f3 tempest-ProjectMemberTests-945597890 None] Creating offline snapshot 1f21b214-b02a-49f7-b69d-0859f193ced5 of volume 4868c65e-3dc8-4e27-ae8d-7c5349b52b58 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:30:53 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf072924-7f5a-4c40-874c-ac057e20b124]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:53 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3ae1b62e-d365-4235-8370-931c7d15c8f3 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:53 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58 Jul 08 01:30:53 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:54 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3ae1b62e-d365-4235-8370-931c7d15c8f3 tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58" returned: 0 in 0.776s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:54 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3ae1b62e-d365-4235-8370-931c7d15c8f3 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58.1f21b214-b02a-49f7-b69d-0859f193ced5 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:54 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58.1f21b214-b02a-49f7-b69d-0859f193ced5 1G Jul 08 01:30:54 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:55 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3ae1b62e-d365-4235-8370-931c7d15c8f3 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58.1f21b214-b02a-49f7-b69d-0859f193ced5 1G" returned: 0 in 0.889s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3ae1b62e-d365-4235-8370-931c7d15c8f3 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58.1f21b214-b02a-49f7-b69d-0859f193ced5 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:55 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58.1f21b214-b02a-49f7-b69d-0859f193ced5 Jul 08 01:30:55 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:55 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3ae1b62e-d365-4235-8370-931c7d15c8f3 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58.1f21b214-b02a-49f7-b69d-0859f193ced5" returned: 0 in 0.703s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:55 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-3ae1b62e-d365-4235-8370-931c7d15c8f3 tempest-ProjectMemberTests-945597890 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58.1f21b214-b02a-49f7-b69d-0859f193ced5 is being set with open permissions: ugo+rw Jul 08 01:30:55 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3ae1b62e-d365-4235-8370-931c7d15c8f3 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58.1f21b214-b02a-49f7-b69d-0859f193ced5 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:55 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58.1f21b214-b02a-49f7-b69d-0859f193ced5 Jul 08 01:30:55 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:56 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3ae1b62e-d365-4235-8370-931c7d15c8f3 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58.1f21b214-b02a-49f7-b69d-0859f193ced5" returned: 0 in 0.635s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:56 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3ae1b62e-d365-4235-8370-931c7d15c8f3 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:56 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58.info Jul 08 01:30:56 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:57 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3ae1b62e-d365-4235-8370-931c7d15c8f3 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58.info" returned: 0 in 0.696s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:57 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-3ae1b62e-d365-4235-8370-931c7d15c8f3 tempest-ProjectMemberTests-945597890 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58.info is being set with open permissions: ugo+rw Jul 08 01:30:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3ae1b62e-d365-4235-8370-931c7d15c8f3 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:57 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58.info Jul 08 01:30:57 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:57 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-3ae1b62e-d365-4235-8370-931c7d15c8f3 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58.info" returned: 0 in 0.686s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:57 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-3ae1b62e-d365-4235-8370-931c7d15c8f3 tempest-ProjectMemberTests-945597890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.487s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:30:57 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-3ae1b62e-d365-4235-8370-931c7d15c8f3 tempest-ProjectMemberTests-945597890 None] Create snapshot completed successfully Jul 08 01:30:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1a3a91b2-0685-4fe5-943d-e0e662d95c0f tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-1f21b214-b02a-49f7-b69d-0859f193ced5-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1a3a91b2-0685-4fe5-943d-e0e662d95c0f tempest-ProjectMemberTests-945597890 None] Lock "cinder-1f21b214-b02a-49f7-b69d-0859f193ced5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1a3a91b2-0685-4fe5-943d-e0e662d95c0f tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-quobyte-4868c65e-3dc8-4e27-ae8d-7c5349b52b58" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1a3a91b2-0685-4fe5-943d-e0e662d95c0f tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-4868c65e-3dc8-4e27-ae8d-7c5349b52b58" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1a3a91b2-0685-4fe5-943d-e0e662d95c0f tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-quobyte-1f21b214-b02a-49f7-b69d-0859f193ced5" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:30:58 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1a3a91b2-0685-4fe5-943d-e0e662d95c0f tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-1f21b214-b02a-49f7-b69d-0859f193ced5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:30:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-1a3a91b2-0685-4fe5-943d-e0e662d95c0f tempest-ProjectMemberTests-945597890 None] Deleting offline snapshot 1f21b214-b02a-49f7-b69d-0859f193ced5 of volume 4868c65e-3dc8-4e27-ae8d-7c5349b52b58 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:30:58 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-1a3a91b2-0685-4fe5-943d-e0e662d95c0f tempest-ProjectMemberTests-945597890 None] snapshot_file for this snap is: volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58.1f21b214-b02a-49f7-b69d-0859f193ced5 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:30:58 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[314f768f-0132-4cbc-abbb-1e22f813d376]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:58 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1a3a91b2-0685-4fe5-943d-e0e662d95c0f tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58.1f21b214-b02a-49f7-b69d-0859f193ced5 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:59 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58.1f21b214-b02a-49f7-b69d-0859f193ced5 Jul 08 01:30:59 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:30:59 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Jul 08 01:30:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1a3a91b2-0685-4fe5-943d-e0e662d95c0f tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58.1f21b214-b02a-49f7-b69d-0859f193ced5" returned: 0 in 0.813s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:30:59 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-1a3a91b2-0685-4fe5-943d-e0e662d95c0f tempest-ProjectMemberTests-945597890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:30:59 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8023804-4114-4ad8-84f4-515b586e1388]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:30:59 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1a3a91b2-0685-4fe5-943d-e0e662d95c0f tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:30:59 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58 Jul 08 01:30:59 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:00 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1a3a91b2-0685-4fe5-943d-e0e662d95c0f tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58" returned: 0 in 0.828s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:00 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1a3a91b2-0685-4fe5-943d-e0e662d95c0f tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58.1f21b214-b02a-49f7-b69d-0859f193ced5 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:00 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58.1f21b214-b02a-49f7-b69d-0859f193ced5 Jul 08 01:31:00 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:01 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1a3a91b2-0685-4fe5-943d-e0e662d95c0f tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58.1f21b214-b02a-49f7-b69d-0859f193ced5" returned: 0 in 0.854s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1a3a91b2-0685-4fe5-943d-e0e662d95c0f tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58.1f21b214-b02a-49f7-b69d-0859f193ced5 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:01 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58.1f21b214-b02a-49f7-b69d-0859f193ced5 Jul 08 01:31:01 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:01 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:31:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Flow 'volume_create_manager' (1823a7d2-a594-4fa4-be49-919337cc5a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:31:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f096e30-33d0-446d-a7d3-f177cf4885a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f096e30-33d0-446d-a7d3-f177cf4885a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-972639286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4a6721f-8631-4afe-a20f-90df8b9eb712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394bf12f80cc4b67b3386625848fb342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:31:02Z,use_quota=True,user_id='ea4f0ac739c64afd9b579bb1ee658a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4ab2c5-955e-40ae-af6d-ab8e8e54b543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4ab2c5-955e-40ae-af6d-ab8e8e54b543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2a3a488-8d11-4128-8ebe-dca0cc088b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2a3a488-8d11-4128-8ebe-dca0cc088b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4a6721f-8631-4afe-a20f-90df8b9eb712', 'volume_name': 'volume-e4a6721f-8631-4afe-a20f-90df8b9eb712', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce46b1fc-7e17-481f-ac41-c34af6983456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce46b1fc-7e17-481f-ac41-c34af6983456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:01 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee45e09-ddf3-4b1f-b465-63b743849996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:01 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Volume e4a6721f-8631-4afe-a20f-90df8b9eb712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4a6721f-8631-4afe-a20f-90df8b9eb712', 'volume_size': 1} Jul 08 01:31:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-972639286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4a6721f-8631-4afe-a20f-90df8b9eb712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394bf12f80cc4b67b3386625848fb342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:31:02Z,use_quota=True,user_id='ea4f0ac739c64afd9b579bb1ee658a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)}" {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:31:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Creating volume e4a6721f-8631-4afe-a20f-90df8b9eb712 {{(pid=87022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:31:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:01 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:31:01 devstack cinder-volume[87022]: INFO cinder.volume.drivers.remotefs [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] casted to osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d Jul 08 01:31:01 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712 1073741824 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:01 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712 1073741824 Jul 08 01:31:01 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:02 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1a3a91b2-0685-4fe5-943d-e0e662d95c0f tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58.1f21b214-b02a-49f7-b69d-0859f193ced5" returned: 0 in 0.639s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:02 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1a3a91b2-0685-4fe5-943d-e0e662d95c0f tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-1f21b214-b02a-49f7-b69d-0859f193ced5" released by "_delete_snapshot" :: held 3.254s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:02 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1a3a91b2-0685-4fe5-943d-e0e662d95c0f tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-4868c65e-3dc8-4e27-ae8d-7c5349b52b58" released by "delete_snapshot" :: held 3.284s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:02 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-1a3a91b2-0685-4fe5-943d-e0e662d95c0f tempest-ProjectMemberTests-945597890 None] Created reservations ['f57b7d16-58e9-4354-947c-8d6a5acd47f9', '1182baeb-63a8-469d-a119-16bd7e2b5eda', '2dbb7b07-b547-4ee9-9033-5f0a43ba8692', '04c36553-9a0c-4613-831b-5aff8a7f6e93'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:31:02 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-1a3a91b2-0685-4fe5-943d-e0e662d95c0f tempest-ProjectMemberTests-945597890 None] Delete snapshot completed successfully. Jul 08 01:31:02 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1a3a91b2-0685-4fe5-943d-e0e662d95c0f tempest-ProjectMemberTests-945597890 None] Lock "cinder-1f21b214-b02a-49f7-b69d-0859f193ced5-delete_snapshot" released by "delete_snapshot" :: held 3.443s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:02 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712 1073741824" returned: 0 in 0.822s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:02 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:02 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712 Jul 08 01:31:02 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:03 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2ca5c3b8-e6eb-41de-be61-588cc297be70 tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-4868c65e-3dc8-4e27-ae8d-7c5349b52b58-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:03 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2ca5c3b8-e6eb-41de-be61-588cc297be70 tempest-ProjectMemberTests-945597890 None] Lock "cinder-4868c65e-3dc8-4e27-ae8d-7c5349b52b58-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:03 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2ca5c3b8-e6eb-41de-be61-588cc297be70 tempest-ProjectMemberTests-945597890 None] Acquiring lock "cinder-quobyte-4868c65e-3dc8-4e27-ae8d-7c5349b52b58" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:03 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2ca5c3b8-e6eb-41de-be61-588cc297be70 tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-4868c65e-3dc8-4e27-ae8d-7c5349b52b58" acquired by "delete_volume" :: waited 0.020s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:03 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[010bf046-5e1f-48bb-8e2c-ae71c0679177]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2ca5c3b8-e6eb-41de-be61-588cc297be70 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:03 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58 Jul 08 01:31:03 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:03 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712" returned: 0 in 0.677s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:03 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'} {{(pid=87022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:31:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee45e09-ddf3-4b1f-b465-63b743849996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4a6721f-8631-4afe-a20f-90df8b9eb712', 'volume_size': 1}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d788fcb9-1d6c-424a-a175-7891291fefcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:03 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Volume volume-e4a6721f-8631-4afe-a20f-90df8b9eb712 (e4a6721f-8631-4afe-a20f-90df8b9eb712): created successfully Jul 08 01:31:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d788fcb9-1d6c-424a-a175-7891291fefcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:03 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Flow 'volume_create_manager' (1823a7d2-a594-4fa4-be49-919337cc5a65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:31:03 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-50869954-fbc3-467b-b520-4324c1775c1f tempest-SnapshotDependencyTests-1677192903 None] Created volume successfully. Jul 08 01:31:03 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2ca5c3b8-e6eb-41de-be61-588cc297be70 tempest-ProjectMemberTests-945597890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58" returned: 0 in 0.780s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:03 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2ca5c3b8-e6eb-41de-be61-588cc297be70 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:04 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58 Jul 08 01:31:04 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-04180b14-7c6f-4090-a11d-7126debe44ee tempest-SnapshotDependencyTests-1677192903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-04180b14-7c6f-4090-a11d-7126debe44ee tempest-SnapshotDependencyTests-1677192903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-04180b14-7c6f-4090-a11d-7126debe44ee tempest-SnapshotDependencyTests-1677192903 None] Creating offline snapshot 7e658e29-103d-481d-a5f9-7012f5a04bc3 of volume e4a6721f-8631-4afe-a20f-90df8b9eb712 {{(pid=87022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:31:04 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[add5d13f-762a-4df1-8ab9-059c65ff8ce0]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-04180b14-7c6f-4090-a11d-7126debe44ee tempest-SnapshotDependencyTests-1677192903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:04 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712 Jul 08 01:31:04 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:04 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2ca5c3b8-e6eb-41de-be61-588cc297be70 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-4868c65e-3dc8-4e27-ae8d-7c5349b52b58" returned: 0 in 0.655s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:04 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2ca5c3b8-e6eb-41de-be61-588cc297be70 tempest-ProjectMemberTests-945597890 None] Lock "cinder-quobyte-4868c65e-3dc8-4e27-ae8d-7c5349b52b58" released by "delete_volume" :: held 1.506s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:04 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-2ca5c3b8-e6eb-41de-be61-588cc297be70 tempest-ProjectMemberTests-945597890 None] Created reservations ['909cd9ca-e3d7-44e5-9a30-7628d6f17ab6', 'a23365c2-8701-4e1f-b77f-fd8122165ffa', '327348fc-849d-41fa-b188-1d742bf12971', 'c50f3692-b555-46e0-b01e-f24307c88e31'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:31:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2ca5c3b8-e6eb-41de-be61-588cc297be70 tempest-ProjectMemberTests-945597890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2ca5c3b8-e6eb-41de-be61-588cc297be70 tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-2ca5c3b8-e6eb-41de-be61-588cc297be70 tempest-ProjectMemberTests-945597890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:04 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-2ca5c3b8-e6eb-41de-be61-588cc297be70 tempest-ProjectMemberTests-945597890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2ca5c3b8-e6eb-41de-be61-588cc297be70 tempest-ProjectMemberTests-945597890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2ca5c3b8-e6eb-41de-be61-588cc297be70 tempest-ProjectMemberTests-945597890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:04 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:31:04 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:04 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-04180b14-7c6f-4090-a11d-7126debe44ee tempest-SnapshotDependencyTests-1677192903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712" returned: 0 in 0.786s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:04 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-04180b14-7c6f-4090-a11d-7126debe44ee tempest-SnapshotDependencyTests-1677192903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.7e658e29-103d-481d-a5f9-7012f5a04bc3 1G {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:04 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.7e658e29-103d-481d-a5f9-7012f5a04bc3 1G Jul 08 01:31:04 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:05 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-2ca5c3b8-e6eb-41de-be61-588cc297be70 tempest-ProjectMemberTests-945597890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.640s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:05 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-2ca5c3b8-e6eb-41de-be61-588cc297be70 tempest-ProjectMemberTests-945597890 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:31:05 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-2ca5c3b8-e6eb-41de-be61-588cc297be70 tempest-ProjectMemberTests-945597890 None] Deleted volume successfully. Jul 08 01:31:05 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-2ca5c3b8-e6eb-41de-be61-588cc297be70 tempest-ProjectMemberTests-945597890 None] Lock "cinder-4868c65e-3dc8-4e27-ae8d-7c5349b52b58-delete_volume" released by "delete_volume" :: held 2.393s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:05 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-04180b14-7c6f-4090-a11d-7126debe44ee tempest-SnapshotDependencyTests-1677192903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.7e658e29-103d-481d-a5f9-7012f5a04bc3 1G" returned: 0 in 0.834s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:05 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-04180b14-7c6f-4090-a11d-7126debe44ee tempest-SnapshotDependencyTests-1677192903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4a6721f-8631-4afe-a20f-90df8b9eb712 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.7e658e29-103d-481d-a5f9-7012f5a04bc3 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:05 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4a6721f-8631-4afe-a20f-90df8b9eb712 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.7e658e29-103d-481d-a5f9-7012f5a04bc3 Jul 08 01:31:05 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:06 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-04180b14-7c6f-4090-a11d-7126debe44ee tempest-SnapshotDependencyTests-1677192903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4a6721f-8631-4afe-a20f-90df8b9eb712 -F qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.7e658e29-103d-481d-a5f9-7012f5a04bc3" returned: 0 in 0.812s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:06 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-04180b14-7c6f-4090-a11d-7126debe44ee tempest-SnapshotDependencyTests-1677192903 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.7e658e29-103d-481d-a5f9-7012f5a04bc3 is being set with open permissions: ugo+rw Jul 08 01:31:06 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-04180b14-7c6f-4090-a11d-7126debe44ee tempest-SnapshotDependencyTests-1677192903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.7e658e29-103d-481d-a5f9-7012f5a04bc3 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:06 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.7e658e29-103d-481d-a5f9-7012f5a04bc3 Jul 08 01:31:06 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:07 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-04180b14-7c6f-4090-a11d-7126debe44ee tempest-SnapshotDependencyTests-1677192903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.7e658e29-103d-481d-a5f9-7012f5a04bc3" returned: 0 in 0.682s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:07 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=70,cinder:UPDATE=92,cinder:INSERT=22,cinder:DELETE=8 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:31:07 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=71,cinder:INSERT=28,cinder:DELETE=8,cinder:UPDATE=95 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:31:07 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-04180b14-7c6f-4090-a11d-7126debe44ee tempest-SnapshotDependencyTests-1677192903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:07 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.info Jul 08 01:31:07 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:08 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-04180b14-7c6f-4090-a11d-7126debe44ee tempest-SnapshotDependencyTests-1677192903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.info" returned: 0 in 0.672s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:08 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-04180b14-7c6f-4090-a11d-7126debe44ee tempest-SnapshotDependencyTests-1677192903 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.info is being set with open permissions: ugo+rw Jul 08 01:31:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-04180b14-7c6f-4090-a11d-7126debe44ee tempest-SnapshotDependencyTests-1677192903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.info {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:08 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.info Jul 08 01:31:08 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:08 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-04180b14-7c6f-4090-a11d-7126debe44ee tempest-SnapshotDependencyTests-1677192903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.info" returned: 0 in 0.677s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:08 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-04180b14-7c6f-4090-a11d-7126debe44ee tempest-SnapshotDependencyTests-1677192903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.560s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:08 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-04180b14-7c6f-4090-a11d-7126debe44ee tempest-SnapshotDependencyTests-1677192903 None] Create snapshot completed successfully Jul 08 01:31:09 devstack cinder-volume[87022]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:31:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Flow 'volume_create_manager' (0ffea5fe-8709-4b2b-acaf-36e9c2a5878a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:31:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dd75cbc-60d1-48fb-9a1d-14e1968f2949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dd75cbc-60d1-48fb-9a1d-14e1968f2949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1e834db-9fb4-4567-bc3e-5d186d045e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394bf12f80cc4b67b3386625848fb342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7e658e29-103d-481d-a5f9-7012f5a04bc3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:31:10Z,use_quota=True,user_id='ea4f0ac739c64afd9b579bb1ee658a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc5a436-82b9-41ea-a3b9-d8e90268e27e),volume_type_id=ebc5a436-82b9-41ea-a3b9-d8e90268e27e)' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da111a09-99b1-4679-9e0e-eca6f8c69c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da111a09-99b1-4679-9e0e-eca6f8c69c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ce1e75-ff83-49a5-acce-c0d00105b76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ce1e75-ff83-49a5-acce-c0d00105b76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f1e834db-9fb4-4567-bc3e-5d186d045e18', 'volume_name': 'volume-f1e834db-9fb4-4567-bc3e-5d186d045e18', 'volume_size': 1, 'snapshot_id': '7e658e29-103d-481d-a5f9-7012f5a04bc3'}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9990a5-15fc-483c-8e13-b3a8b5c2e17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:09 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9990a5-15fc-483c-8e13-b3a8b5c2e17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:10 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34c27ac-db0b-4397-b1ba-3f4688ce3e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:10 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Volume f1e834db-9fb4-4567-bc3e-5d186d045e18: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f1e834db-9fb4-4567-bc3e-5d186d045e18', 'volume_size': 1, 'snapshot_id': '7e658e29-103d-481d-a5f9-7012f5a04bc3'} Jul 08 01:31:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:10 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Acquiring lock "cinder-quobyte-7e658e29-103d-481d-a5f9-7012f5a04bc3-f1e834db-9fb4-4567-bc3e-5d186d045e18" by "_create_volume_from_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:10 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Lock "cinder-quobyte-7e658e29-103d-481d-a5f9-7012f5a04bc3-f1e834db-9fb4-4567-bc3e-5d186d045e18" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Creating volume f1e834db-9fb4-4567-bc3e-5d186d045e18 from snapshot 7e658e29-103d-481d-a5f9-7012f5a04bc3 {{(pid=87022) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:31:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Selected osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d as target Quobyte volume. {{(pid=87022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:31:10 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Acquiring lock "cinder-quobyte-f1e834db-9fb4-4567-bc3e-5d186d045e18" by "_copy_volume_from_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:10 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Lock "cinder-quobyte-f1e834db-9fb4-4567-bc3e-5d186d045e18" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] snapshot: 7e658e29-103d-481d-a5f9-7012f5a04bc3, volume: f1e834db-9fb4-4567-bc3e-5d186d045e18, {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:31:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:10 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4691abf1-1c67-4100-8eed-25d8c7205b0a]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.7e658e29-103d-481d-a5f9-7012f5a04bc3 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:10 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.7e658e29-103d-481d-a5f9-7012f5a04bc3 Jul 08 01:31:10 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:10 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.7e658e29-103d-481d-a5f9-7012f5a04bc3" returned: 0 in 0.777s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4a6721f-8631-4afe-a20f-90df8b9eb712(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:31:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] will copy from snapshot at /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712 {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:31:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Creating direct copy from snapshot {{(pid=87022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:31:10 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[f901c8e4-ec1f-4815-a33e-c1aa4120827e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:11 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712 Jul 08 01:31:11 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:11 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712" returned: 0 in 0.854s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:11 devstack cinder-volume[87022]: DEBUG cinder.utils [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Path /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f1e834db-9fb4-4567-bc3e-5d186d045e18 not found in is_blk_device check {{(pid=87022) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:31:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f1e834db-9fb4-4567-bc3e-5d186d045e18 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:11 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f1e834db-9fb4-4567-bc3e-5d186d045e18 Jul 08 01:31:11 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:16 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f1e834db-9fb4-4567-bc3e-5d186d045e18" returned: 0 in 5.189s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:16 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a104f52-314f-4724-af58-0c24a372b3d7]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:17 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712 Jul 08 01:31:17 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:17 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712" returned: 0 in 0.996s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:17 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Image conversion details: src /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712, size 1024.00 MB, duration 5.19 sec, destination /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f1e834db-9fb4-4567-bc3e-5d186d045e18 {{(pid=87022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:31:17 devstack cinder-volume[87022]: INFO cinder.image.image_utils [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Converted 1024.00 MB image at 197.29 MB/s Jul 08 01:31:17 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.remotefs [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f1e834db-9fb4-4567-bc3e-5d186d045e18 is being set with open permissions: ugo+rw Jul 08 01:31:17 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f1e834db-9fb4-4567-bc3e-5d186d045e18 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:17 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f1e834db-9fb4-4567-bc3e-5d186d045e18 Jul 08 01:31:17 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:18 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f1e834db-9fb4-4567-bc3e-5d186d045e18" returned: 0 in 0.663s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Lock "cinder-quobyte-f1e834db-9fb4-4567-bc3e-5d186d045e18" released by "_copy_volume_from_snapshot" :: held 8.577s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Lock "cinder-quobyte-7e658e29-103d-481d-a5f9-7012f5a04bc3-f1e834db-9fb4-4567-bc3e-5d186d045e18" released by "_create_volume_from_snapshot" :: held 8.605s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:18 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.620s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34c27ac-db0b-4397-b1ba-3f4688ce3e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1e834db-9fb4-4567-bc3e-5d186d045e18', 'volume_size': 1, 'snapshot_id': '7e658e29-103d-481d-a5f9-7012f5a04bc3'}' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4327cb0a-bd26-4c8a-96d0-e66bf7096f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:31:18 devstack cinder-volume[87022]: INFO cinder.volume.flows.manager.create_volume [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Volume volume-f1e834db-9fb4-4567-bc3e-5d186d045e18 (f1e834db-9fb4-4567-bc3e-5d186d045e18): created successfully Jul 08 01:31:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4327cb0a-bd26-4c8a-96d0-e66bf7096f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:31:18 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Flow 'volume_create_manager' (0ffea5fe-8709-4b2b-acaf-36e9c2a5878a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:31:18 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-1d8653a9-90fb-4f9d-bf15-cc4273fbf6e0 tempest-SnapshotDependencyTests-1677192903 None] Created volume successfully. Jul 08 01:31:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b279bd58-1406-4495-80b6-e65847a0ca40 tempest-SnapshotDependencyTests-1677192903 None] Acquiring lock "cinder-7e658e29-103d-481d-a5f9-7012f5a04bc3-delete_snapshot" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b279bd58-1406-4495-80b6-e65847a0ca40 tempest-SnapshotDependencyTests-1677192903 None] Lock "cinder-7e658e29-103d-481d-a5f9-7012f5a04bc3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:18 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b279bd58-1406-4495-80b6-e65847a0ca40 tempest-SnapshotDependencyTests-1677192903 None] Acquiring lock "cinder-quobyte-e4a6721f-8631-4afe-a20f-90df8b9eb712" by "delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b279bd58-1406-4495-80b6-e65847a0ca40 tempest-SnapshotDependencyTests-1677192903 None] Lock "cinder-quobyte-e4a6721f-8631-4afe-a20f-90df8b9eb712" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b279bd58-1406-4495-80b6-e65847a0ca40 tempest-SnapshotDependencyTests-1677192903 None] Acquiring lock "cinder-quobyte-7e658e29-103d-481d-a5f9-7012f5a04bc3" by "_delete_snapshot" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:19 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b279bd58-1406-4495-80b6-e65847a0ca40 tempest-SnapshotDependencyTests-1677192903 None] Lock "cinder-quobyte-7e658e29-103d-481d-a5f9-7012f5a04bc3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-b279bd58-1406-4495-80b6-e65847a0ca40 tempest-SnapshotDependencyTests-1677192903 None] Deleting offline snapshot 7e658e29-103d-481d-a5f9-7012f5a04bc3 of volume e4a6721f-8631-4afe-a20f-90df8b9eb712 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:31:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-b279bd58-1406-4495-80b6-e65847a0ca40 tempest-SnapshotDependencyTests-1677192903 None] snapshot_file for this snap is: volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.7e658e29-103d-481d-a5f9-7012f5a04bc3 {{(pid=87022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:31:19 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d7f94b-ce42-4415-8f9f-e896b8acecda]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b279bd58-1406-4495-80b6-e65847a0ca40 tempest-SnapshotDependencyTests-1677192903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.7e658e29-103d-481d-a5f9-7012f5a04bc3 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:19 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.7e658e29-103d-481d-a5f9-7012f5a04bc3 Jul 08 01:31:19 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:19 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b279bd58-1406-4495-80b6-e65847a0ca40 tempest-SnapshotDependencyTests-1677192903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.7e658e29-103d-481d-a5f9-7012f5a04bc3" returned: 0 in 0.780s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:19 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-b279bd58-1406-4495-80b6-e65847a0ca40 tempest-SnapshotDependencyTests-1677192903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4a6721f-8631-4afe-a20f-90df8b9eb712(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:31:19 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d9a8ed-7c7b-4937-ac95-e164bfd8fd9f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b279bd58-1406-4495-80b6-e65847a0ca40 tempest-SnapshotDependencyTests-1677192903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:19 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712 Jul 08 01:31:19 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:20 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b279bd58-1406-4495-80b6-e65847a0ca40 tempest-SnapshotDependencyTests-1677192903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712" returned: 0 in 0.790s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:20 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b279bd58-1406-4495-80b6-e65847a0ca40 tempest-SnapshotDependencyTests-1677192903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.7e658e29-103d-481d-a5f9-7012f5a04bc3 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:20 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.7e658e29-103d-481d-a5f9-7012f5a04bc3 Jul 08 01:31:20 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:21 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b279bd58-1406-4495-80b6-e65847a0ca40 tempest-SnapshotDependencyTests-1677192903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.7e658e29-103d-481d-a5f9-7012f5a04bc3" returned: 0 in 0.764s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:21 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b279bd58-1406-4495-80b6-e65847a0ca40 tempest-SnapshotDependencyTests-1677192903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.7e658e29-103d-481d-a5f9-7012f5a04bc3 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:21 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.7e658e29-103d-481d-a5f9-7012f5a04bc3 Jul 08 01:31:21 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:22 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:22 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-b279bd58-1406-4495-80b6-e65847a0ca40 tempest-SnapshotDependencyTests-1677192903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712.7e658e29-103d-481d-a5f9-7012f5a04bc3" returned: 0 in 0.647s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b279bd58-1406-4495-80b6-e65847a0ca40 tempest-SnapshotDependencyTests-1677192903 None] Lock "cinder-quobyte-7e658e29-103d-481d-a5f9-7012f5a04bc3" released by "_delete_snapshot" :: held 3.095s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b279bd58-1406-4495-80b6-e65847a0ca40 tempest-SnapshotDependencyTests-1677192903 None] Lock "cinder-quobyte-e4a6721f-8631-4afe-a20f-90df8b9eb712" released by "delete_snapshot" :: held 3.116s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:22 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-b279bd58-1406-4495-80b6-e65847a0ca40 tempest-SnapshotDependencyTests-1677192903 None] Created reservations ['03699f51-1db6-4077-9e40-7798c8c7469e', 'b3f85ef7-b6ce-4deb-b500-1be441de1f37', '43b3cac9-22a5-4b5f-9309-a9f7c3443853', 'daa90652-a6fe-4758-a277-be97f45a31b7'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:31:22 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-b279bd58-1406-4495-80b6-e65847a0ca40 tempest-SnapshotDependencyTests-1677192903 None] Delete snapshot completed successfully. Jul 08 01:31:22 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-b279bd58-1406-4495-80b6-e65847a0ca40 tempest-SnapshotDependencyTests-1677192903 None] Lock "cinder-7e658e29-103d-481d-a5f9-7012f5a04bc3-delete_snapshot" released by "delete_snapshot" :: held 3.271s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:23 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ee19eb42-e977-4fc8-adeb-eee88a0197d3 tempest-SnapshotDependencyTests-1677192903 None] Acquiring lock "cinder-e4a6721f-8631-4afe-a20f-90df8b9eb712-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:23 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ee19eb42-e977-4fc8-adeb-eee88a0197d3 tempest-SnapshotDependencyTests-1677192903 None] Lock "cinder-e4a6721f-8631-4afe-a20f-90df8b9eb712-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:23 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ee19eb42-e977-4fc8-adeb-eee88a0197d3 tempest-SnapshotDependencyTests-1677192903 None] Acquiring lock "cinder-quobyte-e4a6721f-8631-4afe-a20f-90df8b9eb712" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:23 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ee19eb42-e977-4fc8-adeb-eee88a0197d3 tempest-SnapshotDependencyTests-1677192903 None] Lock "cinder-quobyte-e4a6721f-8631-4afe-a20f-90df8b9eb712" acquired by "delete_volume" :: waited 0.015s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:23 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5d044d-450d-4465-ad99-200ae0db8e2c]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:23 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ee19eb42-e977-4fc8-adeb-eee88a0197d3 tempest-SnapshotDependencyTests-1677192903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:23 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712 Jul 08 01:31:23 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:24 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ee19eb42-e977-4fc8-adeb-eee88a0197d3 tempest-SnapshotDependencyTests-1677192903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712" returned: 0 in 0.821s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ee19eb42-e977-4fc8-adeb-eee88a0197d3 tempest-SnapshotDependencyTests-1677192903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:24 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712 Jul 08 01:31:24 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:24 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ee19eb42-e977-4fc8-adeb-eee88a0197d3 tempest-SnapshotDependencyTests-1677192903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-e4a6721f-8631-4afe-a20f-90df8b9eb712" returned: 0 in 0.678s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:24 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ee19eb42-e977-4fc8-adeb-eee88a0197d3 tempest-SnapshotDependencyTests-1677192903 None] Lock "cinder-quobyte-e4a6721f-8631-4afe-a20f-90df8b9eb712" released by "delete_volume" :: held 1.560s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:24 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-ee19eb42-e977-4fc8-adeb-eee88a0197d3 tempest-SnapshotDependencyTests-1677192903 None] Created reservations ['18e07170-f232-491c-884a-229641537d72', 'a9528f3a-d791-4027-8f7b-6c311fcdc850', '1d9f8646-f7e9-4167-ac79-9b0d14d127ab', '793e2b32-3832-4dac-81d9-e93aa5f118d1'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:31:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ee19eb42-e977-4fc8-adeb-eee88a0197d3 tempest-SnapshotDependencyTests-1677192903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ee19eb42-e977-4fc8-adeb-eee88a0197d3 tempest-SnapshotDependencyTests-1677192903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ee19eb42-e977-4fc8-adeb-eee88a0197d3 tempest-SnapshotDependencyTests-1677192903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:24 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ee19eb42-e977-4fc8-adeb-eee88a0197d3 tempest-SnapshotDependencyTests-1677192903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ee19eb42-e977-4fc8-adeb-eee88a0197d3 tempest-SnapshotDependencyTests-1677192903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:24 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ee19eb42-e977-4fc8-adeb-eee88a0197d3 tempest-SnapshotDependencyTests-1677192903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:24 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:31:24 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ee90eb03-3469-474c-83b1-82bd14480d56 tempest-SnapshotDependencyTests-1677192903 None] Acquiring lock "cinder-f1e834db-9fb4-4567-bc3e-5d186d045e18-delete_volume" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ee90eb03-3469-474c-83b1-82bd14480d56 tempest-SnapshotDependencyTests-1677192903 None] Lock "cinder-f1e834db-9fb4-4567-bc3e-5d186d045e18-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ee90eb03-3469-474c-83b1-82bd14480d56 tempest-SnapshotDependencyTests-1677192903 None] Acquiring lock "cinder-quobyte-f1e834db-9fb4-4567-bc3e-5d186d045e18" by "delete_volume" {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:31:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ee90eb03-3469-474c-83b1-82bd14480d56 tempest-SnapshotDependencyTests-1677192903 None] Lock "cinder-quobyte-f1e834db-9fb4-4567-bc3e-5d186d045e18" acquired by "delete_volume" :: waited 0.017s {{(pid=87022) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:31:25 devstack cinder-volume[87022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcf1e8e-9d63-4b82-a4dd-dc7badd0de50]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:31:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ee90eb03-3469-474c-83b1-82bd14480d56 tempest-SnapshotDependencyTests-1677192903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f1e834db-9fb4-4567-bc3e-5d186d045e18 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:25 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:25 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ee19eb42-e977-4fc8-adeb-eee88a0197d3 tempest-SnapshotDependencyTests-1677192903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.679s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:25 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-ee19eb42-e977-4fc8-adeb-eee88a0197d3 tempest-SnapshotDependencyTests-1677192903 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:31:25 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-ee19eb42-e977-4fc8-adeb-eee88a0197d3 tempest-SnapshotDependencyTests-1677192903 None] Deleted volume successfully. Jul 08 01:31:25 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ee19eb42-e977-4fc8-adeb-eee88a0197d3 tempest-SnapshotDependencyTests-1677192903 None] Lock "cinder-e4a6721f-8631-4afe-a20f-90df8b9eb712-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:25 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f1e834db-9fb4-4567-bc3e-5d186d045e18 Jul 08 01:31:25 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:26 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ee90eb03-3469-474c-83b1-82bd14480d56 tempest-SnapshotDependencyTests-1677192903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f1e834db-9fb4-4567-bc3e-5d186d045e18" returned: 0 in 0.782s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ee90eb03-3469-474c-83b1-82bd14480d56 tempest-SnapshotDependencyTests-1677192903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f1e834db-9fb4-4567-bc3e-5d186d045e18 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:26 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f1e834db-9fb4-4567-bc3e-5d186d045e18 Jul 08 01:31:26 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:26 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:26 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ee90eb03-3469-474c-83b1-82bd14480d56 tempest-SnapshotDependencyTests-1677192903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306/volume-f1e834db-9fb4-4567-bc3e-5d186d045e18" returned: 0 in 0.655s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ee90eb03-3469-474c-83b1-82bd14480d56 tempest-SnapshotDependencyTests-1677192903 None] Lock "cinder-quobyte-f1e834db-9fb4-4567-bc3e-5d186d045e18" released by "delete_volume" :: held 1.481s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:27 devstack cinder-volume[87022]: DEBUG cinder.quota [None req-ee90eb03-3469-474c-83b1-82bd14480d56 tempest-SnapshotDependencyTests-1677192903 None] Created reservations ['bef468d6-b308-403c-9dee-dec546f650c5', '70580d65-0bd4-4081-82b1-e54cb2f1fce9', '9c74a75e-9b78-469e-8d6f-74b9f18b07bc', '766a16f0-45b1-4081-95e3-75dc864e0009'] {{(pid=87022) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:31:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ee90eb03-3469-474c-83b1-82bd14480d56 tempest-SnapshotDependencyTests-1677192903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ee90eb03-3469-474c-83b1-82bd14480d56 tempest-SnapshotDependencyTests-1677192903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ee90eb03-3469-474c-83b1-82bd14480d56 tempest-SnapshotDependencyTests-1677192903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:27 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-ee90eb03-3469-474c-83b1-82bd14480d56 tempest-SnapshotDependencyTests-1677192903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-ee90eb03-3469-474c-83b1-82bd14480d56 tempest-SnapshotDependencyTests-1677192903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ee90eb03-3469-474c-83b1-82bd14480d56 tempest-SnapshotDependencyTests-1677192903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:27 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:31:27 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:27 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:27 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-ee90eb03-3469-474c-83b1-82bd14480d56 tempest-SnapshotDependencyTests-1677192903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.705s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:27 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-ee90eb03-3469-474c-83b1-82bd14480d56 tempest-SnapshotDependencyTests-1677192903 None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:31:27 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-ee90eb03-3469-474c-83b1-82bd14480d56 tempest-SnapshotDependencyTests-1677192903 None] Deleted volume successfully. Jul 08 01:31:27 devstack cinder-volume[87022]: DEBUG cinder.coordination [None req-ee90eb03-3469-474c-83b1-82bd14480d56 tempest-SnapshotDependencyTests-1677192903 None] Lock "cinder-f1e834db-9fb4-4567-bc3e-5d186d045e18-delete_volume" released by "delete_volume" :: held 2.399s {{(pid=87022) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:31:37 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:UPDATE=25,cinder:SELECT=15,cinder:DELETE=2,cinder:INSERT=7 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:31:37 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=24,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:31:45 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:31:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:31:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:31:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:31:45 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1e606d7-d86e-4a25-aacd-2a8e88e8fb9d'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:31:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:31:45 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:31:45 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306 Jul 08 01:31:45 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:31:46 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Jul 08 01:31:46 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/df9a7841afacd8f320533ae1917a9306" returned: 0 in 0.642s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:31:46 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:31:46 devstack cinder-volume[87022]: DEBUG oslo_service.periodic_task [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:31:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread count: 28 {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:31:46 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-82d1d894-af38-460c-b8e9-7030977e93e2 None None] thread info: [<_MainThread(MainThread, started 134382216167552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}